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Preface 


Pilot  workload  has  been  a  steadily  increasing 
problem  in  fighter  aircraft  as  technology  has  allowed  more 
capable  and  more  complicated  systems  to  be  integrated  with 
aircraft.  Both  of  us  have  seen  this  problem  in  the  F-4 
where  over  the  years  systems  were  added  to  it  which  gave 
it  more  capability  and  also  increased  the  workload  of  the 
crews.  The  question  of  how  much  workload  is  too  much  will 
eventually  have  to  be  answered.  This  project  was  selected 
by  us  because  we  felt  that  with  our  operational  flying 
experience  combined  with  the  analytical  and  simulation 
methods  plus  the  techniques  which  we  gained  from  the  Stra¬ 
tegic  and  Tactical  Science  Course  at  AFIT  we  could  develop 
a  basic  method  with  which  to  begin  to  evaluate  pilot  work¬ 
load. 

We  want  to  thank  the  personnel  at  the  Wright 
Patterson  Cockpit  Design  Facility  for  allowing  us  to  use 
the  A-10 ,  LANTIRN,  Cockpit  Design  Simulator  to  gather  the 
data  for  aircraft  control  movements  without  which  this  pro¬ 
ject  would  not  have  been  possible.  We  also  want  to  thank 
our  advisor.  Lieutenant  Colonel  Tom  Clark,  who  guided  us 
during  the  course  of  the  project.  We  express  special  thanks 
to  our  wives  and  families  for  their  love  and  patience  with¬ 
out  which  the  past  eighteen  months  would  have  been  intoler¬ 
able. 
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Abstract 


As  new  equipment  is  developed  for  fighter  aircraft, 
new  mission  profiles  are  often  developed.  One  method  of 
evaluating  the  change  in  pilot  workload  associated  with 
this  new  equipment  is  the  development  of  a  man-machine 
simulation  that  will  allow  workload  comparisons.  This 
thesis  undertakes  the  development  and  application  of  such 
a  model . 

The  model  developed  and  used  in  this  study  is  a  time 
sequenced  network  of  required  tasks  with  priority  servicing 
by  a  single  server.  Monte  Carlo  techniques  are  used  to 
induce  randomness  into  the  profile  to  represent  the  vari¬ 
ation  between  individual  missions  and  pilot  techniques.  The 
major  parameters  in  the  model  are  the  flight  control  service 
times,  frequency  of  flight  control  task  initiation,  and  the 
frequency  of  defensive  reaction  task  initiations.  The  model 
incorporates  twenty  different  tasks  in  a  mission  profile 
simulating  thirty  minutes  of  night  tactical  low-level  navi¬ 
gation  using  an  electro-optical  device  for  visual  naviga¬ 
tion  and  terrain  following. 

The  model  was  used  to  compare  pilot  workload  at 
1000,  500,  and  250  feet  above  ground  level  (AGL)  with  three 
levels  of  electronic  countermeasures  (ECM)  service  required 
at  each  altitude.  The  result  indicated  that  workload 
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decreased  with  altitude  in  a  threat  environment  due  to  the 
reduced  number  of  defensive  maneuvers  required.  ECM  task 
reduction  did  not  have  a  significant  effect  on  pilot  work¬ 
load. 

Expansion  of  the  modeled  profile  to  include  the 
weapon  employment  phase  was  recommended.  Alteration  of  the 
model  to  incorporate  mission  success  probabilities  and 
aircraft  equations  of  state  to  determine  minimum  flight 
control  inputs  were  also  recommended. 


A  SIMULATION  TO  ANALYZE  PILOT  WORKLOAD  IN  AN 
ELECTRO -OPTICAL,  NIGHT,  LOW-LEVEL  ENVIRONMENT 


I.  Introduction 


Background 

The  united  States  Air  Force,  until  now,  has  had  no 
low-level  night  attack  capability  with  its  primary  attack 
aircraft.  The  night  capability  has  been  limited  to  radar 
navigation  or  dead  reckoning  to  a  target  area  at  an  alti¬ 
tude  above  all  terrain  along  the  route.  Employment  of 
weapons  has  also  been  seriously  degraded  at  night  because 
of  visual  restrictions.  Equipment  is  presently  being 
developed  that  will  enable  a  single  crew  member  aircraft 
such  as  the  A-10  or  F-16  to  operate  in  the  night  low-level 
arena.  The  equipment  will  provide  a  video  presentation  on 
a  Heads-Up-Display  (HUD)  of  a  sector  of  view  in  front  of 
the  aircraft.  The  presentation  is  proposed  to  appear  three- 
dimensional  and  of  high  enough  resolution  to  allow  very 
low  altitude  (250  feet)  navigation  and  terrain  avoidance 
at  night  in  clear  weather  or  below  clouds.  The  HUD  will 
present  a  sector  scene  with  terrain  features  depicted  in 
the  same  location  and  of  the  same  size  as  they  would  appear 
if  seen  in  the  day  through  the  windscreen.  The  equipment 
has  the  potential  of  increasing  the  night  operational 
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capability  of  single  seat  tactical  aircraft.  In  conjunc¬ 
tion  with  increasing  the  night  capability  of  aircraft,  tech¬ 
nology  has  allowed  electrical  subsystems  to  be  reduced  in 
size;  this  in  turn  has  provided  more  room  for  equipment  in 
the  aircraft  which  potentially  increases  pilot  workload. 

Pilot  workload  is  becoming  a  concern  to  many  agen¬ 
cies  (Ref  13)  such  as  Air  Force  Studies  and  Analysis  and 
Aeronautical  Systems  Division/Equipment  Engineering.  The 
need  to  evaluate  a  system's  potential  effect  on  workload 
prior  to  the  purchase  of  the  system  has  become  very  impor¬ 
tant,  particularly  in  an  age  of  high  cost  systems  and 
emphasis  on  reduced  budgets. 

Currently  there  are  three  main  methods  of  evalu¬ 
ating  pilot  workload  for  new  systems  and  mission  profiles: 

(1)  subjective  opinion  by  experienced  pilots  concerning  the 
workload,  (2)  use  of  weapon  system  simulators  for  workload 
measurement,  and  (3)  modification  of  existing  weapon  sys¬ 
tems  to  perform  as  the  proposed  systems  for  testing  by 
pilovs  who  are  experts  in  ergonomics  and  cockpit  design. 

The  first  method  is  very  subjective  and  tends  to  restrict 
innovative  ideas.  The  second  method  is  expensive  because 
it  requires  sophisticated  simulators  which  are  expensive  to 
construct  and  modify.  A  point  that  is  often  overlooked  is 
that  simulators  lack  the  element  of  danger  associated  with 
actual  flight.  The  simulated  environment  and  lack  of 
danger  could  lead  to  testing  ideas  that  would  not  have  been 
considered  in  actual  flight  tests.  However,  one  negative 
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result  of  buying  a  system  which  had  only  been  tested  in 
the  simulated  environment  would  be  to  find  that  the  system 
was  too  dangerous  for  a  pilot  to  operate  in  actual  flight. 
The  third  method,  modifying  existing  systems,  is  the  most 
effective  but  also  the  most  hazardous,  expensive,  and 
time-consuming . 

Man-machine  simulation  is  a  possible  alternative 
method  of  evaluation  of  pilot  workload.  Although  it  would 
not  be  wise  to  purchase  a  system  based  solely  on  the  results 
of  a  workload  simulation,  the  simulation  model  could  be 
very  useful  in  identifying  blind  alleys,  bottlenecks,  and 
theoretically  potential  areas  or  ideas.  Many  types  of 
human  activities  have  been  modeled  in  the  past  but  were 
not  successful  because  too  many  factors  and  variables  had 
to  be  considered.  Today,  with  better  computers  and  pro¬ 
gressively  more  sophisticated  simulation  languages  such  as 
SAINT  (Ref  9)  and  SLAM  (Ref  8) ,  man-machine  simulations  are 
becoming  more  feasible.  A  simulation  of  a  single  pilot 
flying  a  tactical  low-level  navigation  mission  at  night 
could  be  very  beneficial  in  evaluating  proposed  night 
attract  systems . 

Problem  Statement 

In  the  Night  All  Weather  A-10  Flight  Test  Pilot 
Report,  two  test  pilots  expressed  their  opinion  of  the 
pilot  workload  in  the  night  low-level  environment  (Ref  1) . 

As  experts  in  flight  test  of  new  systems,  they  stated  that 
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workload  at  1000  feet  AGL  (the  altitude  flown  in  the  test) 
was  very  high.  They  also  stated  that  they  felt  workload  at 
lower  altitudes  would  be  beyond  pilot  capabilities.  In 
another  portion  of  the  report  they  expressed  a  need  for  a 
threat  management  system  for  tactical  missions  to  relieve 
the  pilot  of  the  task  of  electronic  countermeasures  (ECM) 
activities.  A  simulation  of  this  mission  at  altitudes  of 
1000,  500  and  250  feet  with  varying  ECM  task  levels  could 
be  used  to  extend  the  analysis  of  pilot  workload  in  this 
potential  flight  regime.  Although  this  thesis  addresses 
the  specific  problem  mentioned  above,  the  underlying  pur¬ 
pose  of  the  research  study  is  to  demonstrate  a  methodology 
for  man-machine  simulation  in  the  workload  analysis  field. 

Scope 

This  thesis  deals  with  modeling  the  physical 
activities  required  of  a  pilot  on  a  tactical  low-level 
navigation  mission  using  a  limited  field  of  view  video 
Heads-Up  Display  (HUD) .  The  modeled  profile  does  not 
include  weapon  employment  or  target  acquisition.  Although 
it  addresses  the  impact  of  stress  due  to  enemy  threat  sys¬ 
tems  and  altitude  flown  above  ground  level,  the  model  does 
not  address  the  impact  of  the  pilot's  mistrust  of  the  sys¬ 
tem,  the  anticipated  vertigo-inducing  effects  of  the  HUD 
or  external  visual  distractions,  the  discomfort/anxiety 
associated  with  manual  terrain  following  and  maneuvering 
using  a  reduced  visual  field  or  any  equipment  malfunctions. 
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Objectives  and  Research  Design 

The  objective  of  this  study  was  to  provide  an 
example  of  the  utility  of  a  pilot-aircraft  simulation  model 
to  examine  pilot  workload.  The  specific  objectives  were  to 
develop  a  model  that  demonstrated  feasible  methodology  for 
collecting  interval  data  on  a  pilot-aircraft  system  and  to 
demonstrate  the  use  of  that  data  in  making  workload  com¬ 
parisons. 

The  research  design  used  in  this  study  is  shown  in 
Figure  1.  The  first  three  steps  included  defining  the 
problem  and  mapping  this  research  design,  defining  the  low- 
level  mission  characteristics  and  the  specific  mission  pro¬ 
file,  and  forming  the  overall  model  concept  and  structure. 

The  model  parameter  determination  and  model  computeriza¬ 
tion  was  an  iterative?  process  as  shown  in  Figure  1.  Esti¬ 
mated  parameters  were  refined  after  being  used  in  the  model 
if  their  contribution  was  significant  in  the  overall  results. 
The  seventh  step  involved  exercising  the  model  in  accord¬ 
ance  with  the  experimental  design  so  data  analysis  could  be 
accomplished  in  the  next  step.  After  data  were  analyzed  and 
discussed,  the  research  design  terminated  with  the  presenta¬ 
tion  of  conclusions  and  recommendations. 

Assumptions 

The  following  assumptions  were  made  for  the  pur¬ 
pose  of  bounding  this  thesis  to  a  manageable  study. 
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1.  A  pilot  is  a  serial  processor  of  assigned  tasks. 
These  tasks  may  be  interrupted  and  restarted  many  times  but 
parallel  task  processing  is  not  possible. 

2.  Tasks  are  serviced  or  preempted  on  a  priority 
basis  and  the  priority  is  always  obeyed. 

3.  Some  tasks  must  be  performed  prior  to  an  event 
taking  place  in  the  profile  while  other  tasks  may  await 
service  for  extended  periods  of  time.  Not  all  tasks  are 
critical  to  survival  or  accomplishment  of  the  mission. 

4.  The  mission  begins  at  a  known,  desired  point 
and  the  pilot  and  aircraft  survive  the  threat  posed  by 
enemy  defensive  systems  through  profile  termination. 

Overview 

The  remainder  of  this  thesis  is  devoted  to  the 
accomplishment  of  the  objectives  specified  earlier. 

Chapter  II  contains  an  explanation  of  the  mission  concept 
and  develops  the  model  profile.  The  model  and  the  model 
parameters  are  described  in  Chapter  III  while  Chapter  IV 
contains  the  development  and  collection  of  data  used  in 
determining  the  flight  control  task  parameters.  Data 
collection  is  covered  in  Chapter  V.  Data  analysis  and 
results  are  contained  in  Chapter  VI.  The  final  chapter 
presents  conclusions,  recommendations  and  suggestions  for 
expanding  the  scope  of  pilot  modeling. 
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II.  Mission  Concept 

A  night,  low-level  navigation  mission  in  a  combat 
environment  is  modeled  in  this  thesis.  The  model  specifi¬ 
cally  addresses  the  navigation  portion  of  a  combat  profile 
with  no  reference  to  takeoff,  target  acquisition,  weapons 
employment,  or  recovery.  The  mission  begins  at  a  start 
point  and  proceeds  for  thirty  minutes.  Threat  reactions 
are  treated;  however,  aircraft  malfunction,  mission  abort, 
or  aircraft  destruction  are  not  allowed.  On  actual  flights, 
many  different  pilot  techniques  are  used  to  accomplish 
tasks  which  are  necessary  to  obtain  the  highest  probability 
of  survival  and  mission  success  in  night  low  altitude  navi¬ 
gation.  The  tasks  can  be  grouped  into  families  based  on 
the  task  purpose,  each  family  having  a  different  level  of 
importance.  This  chapter  is  devoted  to  a  general  discus¬ 
sion  of  the  tactical  low-level  navigation  mission  and  a 
description  of  the  specific  mission  modeled.  A  mission 
description  is  necessary  to  show  how  the  similation  was 
built  around  the  modeler's  mission  concept. 

Tactical  low-level  navigation  is  accomplished  by  a 
pilot  in  a  single  cockpit  aircraft  performing  a  sequential 
set  of  activities  or  tasks.  The  procedural  nature  of  the 
mission  lends  itself  to  the  design  of  cycles  of  time  to 
accomplish  sequences  of  tasks  which  will  most  efficiently 
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use  the  pilot's  limited  time  and  provide  cues  for  the  pilot 
to  accomplish  tasks  that  might  be  forgotten.  The  tasks 
can  be  grouped  into  four  main  areas  which  are  based  on  the 
objectives  of  the  tasks  (see  Figure  2).  The  tasks  are 
grouped  by  their  relation  to:  (1)  aircraft  control,  (2) 
navigation,  (3)  monitoring  and  operation  of  aircraft  sys¬ 
tems,  and  (4)  tasks  associated  with  recognizing  and  counter¬ 
ing  enemy  threat  systems.  Aircraft  control  tasks  are  move¬ 
ments  of  the  flight  controls,  stick,  throttle(s),  and 
rudder,  which  cause  the  aircraft  to  perform  as  desired  by 
the  pilot.  They  are  important  and  must  be  accomplished 
frequently  in  the  low  altitude  environment  to  avoid  hitting 
the  ground.  A  repeated  failure  to  accomplish  these  tasks 
over  just  a  short  period  of  time  would  result  in  the 
destruction  of  the  aircraft  and  loss  the  pilot. 

The  second  group  of  tasks  have  to  be  performed  if 
the  pilot  wants  to  know  where  he  is,  where  he  is  going,  or 
how  to  get  to  a  desired  location.  Airspeed,  heading,  time, 
present  location,  predicted  location,  and  distance  to  the 
predicted  location,  all  relate  to  information  that  must  be 
known  by  the  pilot  for  him  to  successfully  navigate  the 
aircraft.  The  tasks  in  this  group  are,  in  some  cases,  as 
simple  as  looking  at  a  clock  or  instrument  and  interpreting 
the  information  provided  by  the  instrument.  Other  tasks 
are  more  complicated  and  time-consuming.  Some  examples  are 
updating  the  inertial  navigation  system  (INS) ,  selecting 
the  desired  coordinates  on  the  INS  of  the  point  to  which 
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Fig.  2.  Task  Grouping 

the  pilot  wants  to  fly,  and  map  reading.  All  these  tasks 
relate  to  aids  to  navigation.  Classical  navigation,  dead 
reckoning  (DR) ,  will  not  be  used  as  the  primary  means  of 
navigation  in  the  tactical  night  low  altitude  environment. 
DR  requires  that  the  pilot  start  at  a  known  location  and 
fly  a  constant  heading  for  a  planned  period  of  time  to 
arrive  at  a  predicted  location.  The  classical  technique 
of  DR  is  not  feasible  for  a  night  low-level  mission  in  a 
hostile  environment.  Optimum  use  of  terrain  features  and 
reactions  to  enemy  threat  systems  will  not  allow  a  pilot 
to  maintain  the  constant  heading  or  speed  required  for  DR 
.navigation.  Electronic  aids  to  navigation  must  therefore 
be  used  to  allow  aircraft  maneuvering  and  rerouting  of  the 
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mission  in  the  night  low  altitude  environment..  The  time 
required  for  a  pilot  to  operate  the  electronic  navigation 
aids  requires  less  effort  for  the  increased  capabilities 
than  classic  DR  navigation. 

The  third  group  of  tasks  is  the  systems  operation 
group.  It  is  broad  and  in  some  cases  the  tasks  might  seem 
to  overlap  the  other  groups,  particularly  navigational 
tasks.  Typical  tasks  in  this  group  include  switch  changes 
for  fuel  transfer  and  INS  update.  INS  update  overlaps  the 
navigation  task  group,  but  in  this  case  it  is  treated  as  a 
task  required  to  insure  that  the  INS  system  is  operating 
properly.  An  "OPS  Check,"  which  is  a  collection  of  tasks 
performed  to  insure  that  an  aircraft  and  its  important 
systems  are  operating  properly,  is  also  in  this  group. 
Examples  of  items  in  an  "OPS  Check"  are  checks  of  the 
engine  instruments,  fuel  state,  malfunction  telelite  panel, 
and  the  pilot  life  support  systems.  The  tasks  in  group 
three  can  be  neglected  for  varying  periods  of  time .  How¬ 
ever,  the  longer  the  period  between  checks  the  greater  the 
possibility  of  serious  problems  going  undetected.  These 
problems  could  induce  errors  in  navigation,  allow  fuel 
starvation,  or  affect  aircraft  flight  control  systems. 

The  failure  of  a  pilot  to  be  aware  of  any  potential  problem 
could  lead  to  more  serious  problems  which  could  eventually 
cause  the  destruction  of  the  aircraft  and  the  death  of  the 
pilot. 
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The  fourth  group  deals  with  threat  tasks.  The 
first  three  groups  pertained  to  all  low  level  navigation 
missions,  the  fourth  relates  to  only  tactical  missions  in 
a  hostile  environment.  The  tasks  associated  with  this 
group  involve  recognizing  visual  or  electronic  indications 
of  enemy  threat  systems  and  initiating  defensive  maneuvers 
or  selecting  electronic  or  decoying  methods  to  counter  the 
threat.  The  critical  nature  of  each  of  these  tasks  varies 
depending  on  the  seriousness  of  the  threat.  Failing  to 
notice  a  need  or  failing  to  adequately  accomplish  a  task 
relating  to  a  threat  may  have  no  impact,  but  would  likely 
result  in  the  imminent  loss  of  the  aircraft  and  the  pilot. 

The  above  information  is  used  as  a  base  for  the 
concept  of  the  modeled  mission.  The  remainder  of  this 
chapter  deals  with  the  specific  profile  modeled  and  the 
rationale  for  including  each  task  in  the  model. 

The  navigation  mission  modeled  begins  on  the 
friendly  side  of  the  Forward  Edge  of  the  Battle  Area  (FEBA) 
and  proceeds  across  and  beyond  the  FEBA.  The  average  mis¬ 
sion  has  four  turn  points  and  five  legs  (path  flown 
between  turn  points) ,  each  leg  being  approximately  seven 
minutes  long.  During  the  mission  the  pilot  processes 
tasks  from  each  of  the  four  previously-mentioned  groups. 
Tasks  from  the  aircraft  control  group  are  those  that  the 
pilot  uses  to  maintain  aircraft  control.  These  are  the 
most  important  tasks  in  that  they  must  be  performed  very 
frequently  or  the  aircraft  will  deviate  too  far  from  the 
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intended  flight  path  which  would  result  in  the  aircraft 
striking  the  ground.  The  movements  of  the  flight  controls 
by  an  experienced  pilot  are  the  direct  result  of  the 
pilot's  perception  of  the  cues  on  the  HUD.  The  cues  are 
in  two  forms,  the  visual  presentation  of  the  terrain  in 
front  of  the  aircraft  and  indicators  which  show  the  pilot 
and  aircraft's  airspeed,  attitude,  altitude  AGL,  and  navi¬ 
gation  information.  The  visual  presentation  shows  a  view 
of  the  terrain  in  front  of  the  aircraft  in  a  section  thirty 
degrees  wide  and  twenty  degrees  high.  The  depth  of  view 
displays  objectives  between  3000  and  30,000  feet  ahead  of 
the  aircraft  under  ideal  atmospheric  conditions.  In  the 
course  of  a  mission  the  pilot  must  almost  continuously 
move  the  flight  controls  to  guide  the  aircraft  along  the 
intended  three-dimensional  path  he  wants  it  to  follow. 
Specific  tasks  contained  in  the  mission  concept  of  flight 
control  task  group  besides  flight  control  movements  are 
turns  required  at  the  navigation  points  and  defensive 
maneuvers  which  are  necessary  at  random  points  in  the  mis¬ 
sion  to  counter  enemy  threats.  At  all  turn  points,  flight 
control  movements  are  part  of  the  tasks  required  to  turn 
the  aircraft;  however,  they  are  not  the  same  movements 
used  by  the  pilot  in  straight-line  navigation  between  turn 
points. 

The  same  is  true  of  defensive  maneuvers.  The  pilot 
uses  flight  control  inputs  to  control  the  aircraft  but 
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again  the  inputs  are  not  the  same  type  used  zo  control  the 
aircraft  in  straight-line  navigation. 

Navigation  tasks  relate  to  flight  control  tasks 
in  that  without  a  knowledge  of  an  intended  course  from  the 
present  location  the  pilot  would  not  know  how  to  move  the 
flight  controls  to  navigate  the  aircraft.  Navigation 
tasks  are  those  tasks  that  must  be  accomplished  by  a  pilot 
to  maintain,  check,  and  update  navigational  aids  such  as 
the  INS,  clock,  airspeed  indicator,  and  heading  indicator. 
Mission  success  and  survival  depends  on  precise  navigation 
to  place  the  desired  turnpoint  or  target  within  the  limited 
view  of  the  video  sensor.  Should  a  target  or  turnpoint  not 
be  within  the  field  of  view  of  the  video  system,  the  proba¬ 
bility  of  mission  success  would  be  reduced,  if  not  totally 
negated.  DR,  the  classical  form  of  navigation,  is  not 
included  in  the  mission  concept  for  the  reasons  previously 
mentioned.  Failure  of  the  navigational  aids  is  not 
addressed  in  the  mission  concept  because  it  would  not  con¬ 
tribute  to  the  study  of  pilot  workload  on  the  mission. 

This  is  based  on  the  belief  that  a  mission  abort  would 
result  from  such  equipment  failures. 

The  aircraft  systems  monitoring  and  operating  tasks 
are  accomplished  on  an  as-time-permits  basis.  These  tasks 
are  accomplished  by  a  pilot  to  insure  the  proper  operation 
of  the  aircraft  and  its  subsystems.  They  are  monitoring 
tasks  more  than  manipulating  tasks.  Monitoring  fuel 
remaining,  observation  electronic  countermeasure  (ECM) 
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systems,  and  INS  indications  are  examples  of  specific  tasks 
in  this  group.  Crosschecks  of  the  displayed  HUD  informa¬ 
tion  with  cockpit  instruments  to  confirm  correct  airspeed, 
aircraft  attitude,  altitude  AGL,  heading,  and  navigation 
information  to  the  next  turn  point  are  key  tasks  which  a 
pilot  uses  to  confirm  the  accuracy  of  and  maintenance  of 
his  confidence  in  the  video  and  HUD  system.  OPS  checks 
are  also  required  tasks  in  this  group.  Most  pilots  have  a 
sequence  they  use  to  accomplish  all  these  tasks  in  an 
on-going  cyclic  manner.  They  are  usually  initiated  at 
points  in  the  mission  where  control  of  the  aircraft  is  less 
critical  and  the  attention  of  the  pilot  can  be  safely 
diverted  for  very  short  periods,  sufficient  for  the  pilot 
to  analyze  what  an  instrument  is  indicating. 

In  the  course  of  a  combat  mission,  threats  will  be 
present.  The  final  group  of  tasks  are  those  where  the 
pilot  is  involved  in  detecting,  monitoring  and  reacting  to 
threat  indications  from  the  Radar  Warning  Receiver  (RWR) 
and  visual  threat  sightings.  They  also  include  actions 
taken  to  decoy  the  threat  systems  with  chaff  or  flares 
from  countermeasures  pods. 

The  tasks  mentioned  in  this  discussion  are  the  only 
type  tasks  to  be  modeled.  Other  tasks  could  easily  be 
included  to  adapt  to  profile  changes  or  equipment  modifi¬ 
cations.  These  tasks,  however,  were  considered  to  be  an 
accurate  representation  of  tasks  required  on  a  low  level 
mission  in  a  hostile  environment.  This  judgement  was  based 
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on  a  combined  experience  of  the  modelers  wjtn  over  5000 
flying  hours  in  the  tactical  operation  of  F-4  and  F-5 
.lm.»ft  in  three  major  tactical  commands  and  900  flying 


hours  of  combat  experience.  The  specific 
times  and  frequency  of  task  requirements 


task  service 
are  discussed 


in  Chapter  III* 
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III.  The  Model 


Introduction 

The  thesis  model  is  described  in  this  chapter  by 
presenting  the  basic  model  concept,  the  mechanics  of  the 
four  segments  of  the  model  structure,  the  specific  model 
parameters  and  the  validation  and  verification  process  used 
to  establish  confidence  in  the  model.  Model  flow  charts, 
network  diagrams  and  a  documented  computer  code  listing 
are  contained  in  Appendices  A  and  B.  A  new  simulation 
model  was  developed  for  this  study  because  no  existing 
models  addressed  pilot  workload  in  the  low  altitude  environ¬ 
ment. 

The  model  is  a  time  sequenced  network  simulation 
employing  SLAM  (Simulation  Language  for  Alternative  Model¬ 
ing)  to  model  a  single  pilot  flying  a  thirty-minute  night 
low-level  mission  in  a  tactical  threat  environment.  The 
model  utilizes  normal,  exponential  and  discrete  empirical 
distributions  to  initiate  the  repetitive  mission  require¬ 
ments  for  twenty  different  tasks  and  to  determine  the 
required  task  service  times.  Task  servicing  is  modeled 
by  utilizing  queueing  and  priority  servicing  of  the  tasks 
to  determine  required  and  completed  service  times  in  order 
to  measure  pilot  workload.  Use  of  the  model  allows  the 
comparison  of  pilot  workload  based  on  service  time  for 
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differing  profiles  and  task  servicing  requirements  of  dif¬ 
fering  equipment  configurations. 

Model  Structure  Segments 

The  network  model  structure  can  be  divided  into 
four  segments.  These  segments  are  task  input,  queueing, 
service  and  data  output.  Each  task  enters  the  network  via 
an  input  distribution  based  on  the  task  requirement  fre¬ 
quency  in  the  actual  system.  The  task  proceeds  to  a  queue 
where  it  awaits  service  based  on  its  assigned  priority  and 
is  serviced  by  a  single  server.  The  task  is  then  routed 
through  an  output  routine  to  collect  service  time  informa¬ 
tion.  This  basic  structure  is  followed  by  all  modeled 
tasks  but  the  details  of  each  segment  of  the  model  are  much 
more  sophisticated  than  this  simple  trace  implies.  Each 
of  the  four  segments  is  discussed  in  detail  below. 

Task  Inputs.  Task  initiation  is  based  on  repli¬ 
cating  the  actual  task  sequencing  on  a  representative  mis¬ 
sion.  This  sequencing  follows  four  types  of  initiation 
loops  (Figure  3) .  The  sequencing  loops  are  based  on  time 
intervals,  location,  server  availability  and  pilot  per¬ 
ception. 

The  first  input  loop  represents  tasks  that  must  be 
accomplished  on  a  time  interval  basis.  For  example,  a 
navigation  point  search  routine  is  required  periodically 
to  confirm  aircraft  location.  The  model  uses  a  normal 
distribution  with  a  user-defined  mean  and  standard 


Fig.  3.  Types  of  Task  Initiation  Loops 


deviation  to  initiate  tasks  into  the  system  so  they  may 
arrive  in  the  queue  at  an  interval  with  some  variability. 

The  second  type  of  initiation  loop  is  one  based  on 
aircraft  location.  As  was  mentioned  in  Chapter  II,  low- 
level  procedures  are  often  based  on  inherent  cues  in  the 
profile  to  "jog  the  memory"  of  the  pilot.  The  tendency, 
therefore,  is  to  require  a  series  of  tasks  to  be  initiated 
when  approaching  or  departing  a  planned  turn  point.  A 
typical  example  is  checking  the  fuel  status  at  each  turn 
point.  Since  navigation  leg  lengths  are  based  on  a  desired 
leg  time,  turn  point  initiated  tasks  are  based  on  both 
aircraft  location  and  time  intervals.  Some  tasks  such  as 
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defensive  reactions  are  based  solely  on  aircraft  location. 
Location  based  inputs  are  initiated  in  the  model  by  allow¬ 
ing  the  release  of  one  task  to  initiate  another  group  of 
tasks. 

The  third  type  task  initiation  loop  is  based  on 
tasks  that  require  service  during  some  time  period  but  the 
specific  time  of  completion  is  unimportant.  For  example, 
crosschecks  of  information  between  the  HUD  and  cockpit 

s' 

instruments  can  be  accomplished  at  any  time  but  they  should 
be  accomplished  at  least  once  per  navigation  leg.  This  is 
modeled  by  initiating  the  task  requirement  at  the  beginning 
of  each  navigation  leg  and  allowing  service  anytime  along 
that  leg  which  equates  to  an  available  time  sequencing. 

The  task  is  performed  when  the  server  is  not  servicing 
higher  priority  tasks.  If  the  task  is  not  accomplished  by 
the  next  turn  point  the  new  task  is  initiated  but  is  sent 
to  a  data  collection  routine  rather  than  the  service  queue. 
The  collection  routine  provides  an  indication  that  the  task 
was  not  performed  due  to  higher  priority  task  servicing. 

The  last  task  input  sequencing  routine  is  based  on 
the  pilot's  perceived  need  for  the  task.  In  the  case  of 
aircraft  control  tasks  this  is  modeled  by  using  one  dis¬ 
crete  empirical  distribution  for  the  frequency  of  task 
inputs  and  another  for  the  length  of  service  time.  These 
distributions  are  interrupted  at  each  turn  point  by  the 
initiation  of  a  task  to  turn  the  aircraft  to  a  new  naviga¬ 
tion  heading.  Interruptions  are  also  caused  by  defensive 
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maneuvers  initiated  in  the  defensive  reaction  routine.  The 
model  does  not  actually  halt  the  flight  control  distribu¬ 
tions  but  instead  removes  the  aircraft  control  tasks  that 
entered  the  service  queue  while  the  turn  or  defensive 
maneuver  was  being  serviced.  The  removed  tasks  are  dis¬ 
carded  because  they  are  assumed  to  have  been  accomplished 
as  part  of  the  flight  control  manipulations  of  the  other 
tasks. 

All  system  inputs  are  based  on  distribution  param¬ 
eters  that  are  discussed  later.  The  assigning  of  a  task 
identification  number,  service  time  requirement,  service 
priority  and  a  service  time  segmenting  code  is  accomplished 
in  each  input  routine . 

Task  Queueing.  The  queueing  system  for  this  model 
is  required  in  order  co  simplify  input  routines  and  to  allow 
tasks  to  await  service  on  a  priority  basis.  The  complete 
queueing  system  encompasses  three  queues,  each  with  a  dif¬ 
fering  purpose  (Figure  4).  The  first  receives  all  non¬ 
flight  control  tasks  (regular  tasks)  and  continuously 
rerar.ks  them  to  maintain  the  highest  priority  in  the  first 
position  in  the  queue.  This  queue  has  an  infinite  capacity 
and  handles  each  task  only  one  time  and  releases  the  task 
into  the  service  scheme.  The  second  queue  is  an  integral 
part  of  the  service  scheme  for  regular  tasks.  This  queue 
has  a  capacity  of  one  and  may  handle  each  specific  task 
many  times.  The  third  queue  was  used  for  tasks  involving 
flight  control  movements  (critical  tasks) .  This  queue  has 
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Fig.  4.  Queue  and  Service  Diagram 


an  infinite  capacity  and  a  priority  ranking  system  too, 
but  it  also  allows  the  tasks  entering  the  system  and  pass¬ 
ing  through  it  a  service  preemption  capability.  The  pre¬ 
emptive  capability  was  necessary  to  model  the  entry  into 
service  of  critical  tasks  that  require  immediate  service. 
The  service  ramifications  of  the  two  different  type  queues 
is  discussed  next. 

Task  Service.  Task  servicing  involved  a  scheme 
of  using  a  single  server  to  perform  tasks  as  they  were 
released  from  the  queues.  The  sequence  of  service  for  a 
regular  task  began  with  its  release  from  the  first  queue 
(regular  task  queue) .  It  then  entered  the  service  queue 
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and  awaited  completion  of  the  previous  task.  When  that 
task  was  completed  the  new  task  was  serviced  and  released 
to  the  output  routine.  This  is  an  example  of  the  least 
complex  sequence  possible  in  the  model  service  scheme. 

More  sophisticated  sequence  encompasses  the  multiple  task 
servicing  and  task  preemption. 

As  was  mentioned  earlier,  each  task  was  assigned  a 
service  time  and  a  service  segmentation  code  when  it 
entered  the  system.  The  segmentation  code  allowed  tasks 
to  be  marked  for  more  than  one  service  cycle  by  dividing 
the  required  service  time  into  equal  user- specified  seg¬ 
ments.  For  example,  a  service  time  could  be  divided  into 
three  parts.  The  task  would  then  enter  service,  complete 
one  third  of  the  required  service  time  and  return  to  the 
service  queue  (Figure  4) .  When  the  ocher  task  in  this 
cycle  completed  its  segment  of  service  time  the  original 
task  would  reenter  service  for  the  second  third  of  its 
total  service  time  and  then  return  to  the  service  queue. 
This  would  continue  until  every  segment  of  the  task  service 
was  completed  and  the  task  would  then  proceed  to  the  out¬ 
put  routine.  This  "multiple  servicing"  scheme  models  the 
act  of  beginning  one  task  and  momentarily  switching  between 
that  task  and  another  to  accomplish  both  tasks  apparently 
simultaneously.  The  total  service  time  for  servicing  both 
tasks  would  still  be  the  sum  of  the  individual  task  service 
times  but  the  variance  of  task  servicing  delays  would  be 
reduced.  This  scheme  is  a  good  simulation  of  performing 
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tasks  that  require  an  activity  to  initiate  service  and  then 
a  waiting  period  prior  to  service  completion. 

The  next  level  of  complication  in  the  service 
scheme  is  the  initiation  of  a  critical  task  while  a  lower 
priority  task  is  in  service.  In  this  case  the  lower  pri¬ 
ority  task  in  service  is  returned  to  the  queue  from  which 
it  entered  service  and  reranked  in  that  queue  with  the 
remaining  service  time  noted  for  future  service.  When  the 
preempting  task  completes  service  the  other  tasks  begin 
service  again.  All  preemptive  tasks  have  a  segmentation 
code  of  one  so  they  receive  only  one  service  period  prior 
to  the  data  collection  routine. 

The  final  portion  of  the  service  scheme  is  the 
modeling  of  the  impact  of  stress  on  the  server.  This  is 
accomplished  by  using  the  Monte  Carlo  technique  to  deter¬ 
mine  if  the  task  was  correctly  serviced.  A  random  number 
is  compared  to  a  stress  factor  parameter  and  if  the  random 
number  is  greater  than  the  stress  factor  the  task  is  sent 
to  the  appropriate  queue  to  be  reaccomplished  (Figure  5) . 
Since  the  incorrect  accomplishment  of  a  flight  control  task 
creates  an  additional  error  in  the  aircraft  position, 
these  tasks  were  reinitiated  twice  to  model  correcting 
the  ferror  and  then  accomplishing  the  original  task.  The 
stress  factor  parameter  is  a  variable  that  decreases  as  the 
stress  of  the  mission  increases.  The  amount  of  decrease 
is  based  on  the  number  of  ECM  tasks  required  in  the  last 
two  minutes,  the  service  of  a  defensive  maneuver  in  the 
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last  ten  minutes  and  the  success  or  failure  of  the  last 
navigation  search  routine  (this  success  or  failure  is  also 
based  on  a  Monte  Carlo  routine) .  The  no-stress  situation 
value  for  the  stress  parameters  is  .97  (Ref  11:15).  The 
amount  of  parameter  decrease  for  each  factor  is  shown  in 
Table  I.  The  table  values  are  based  on  the  expert  opinion 
of  the  modelers. 

Model  Data  Collection  and  Output .  The  collection 
of  data  pertinent  to  this  study  was  accomplished  in  con¬ 
junction  with  the  queueing  system  and  the  service  scheme. 
As  a  task  entered  the  queueing  system  its  required  service 
time  was  collected.  This  service  time  was  then  added  to 
the  sum  of  the  previous  times  for  that  task  and  to  the  sum 
of  the  total  tasking  time.  When  a  task  completed  service 


TABLE  I 


STRESS  PARAMETFR  DECREASE  BY  FACTOR 


Factor 

Amount  of 
Decrease 

Comment 

Defensive  Maneuver 

.03 

Doubles 

Error 

No  Stress 
Rate 

Unsuccessful  Navigation 
Point  Search 

.03 

Doubles 

Error 

No  Stress 
Rate 

ECM  Tasking 

.0001X 
(ECM  Time)* 

*ECM  time  =  total  of  ECM  task  service  time  over  the 
last  120  seconds. 

(each  segment  of  service  for  segmented  tasks) ,  the  com¬ 
pleted  service  time  was  added  to  the  total  time  of  com¬ 
pleted  tasks  of  that  time  and  to  the  total  serviced  tank 
time.  At  the  end  of  each  simulation  run  this  data  was 
recorded  to  allow  future  data  evaluation. 

The  output  of  the  total  times  for  each  task  allowed 
the  comparison  of  time  required  to  time  accomplished  by 
task.  This  comparison  identified  incomplete  service  by 
task.  The  output  of  the  aggregated  times  allowed  a  com¬ 
parison  of  overall  required  service  time  to  overall  accom¬ 
plished  time.  This  provided  total  workload  data  for  com¬ 
parative  analysis  between  user-selected  mission  profiles 
or  equipment  configurations.  The  specific  techniques  used 
to  make  the  comparative  analysis  are  explained  in  Chapter  V. 
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SLAM  summary  reports  at  the  end  of  each  simulation 
run  also  provided  useful  output  data.  This  summary  con¬ 
tained  the  percentage  utilization  of  the  server,  the  number 
of  times  each  task  was  sent  to  the  queueing  system  and  the 
total  number  of  tasks  that  were  released  from  service. 

These  numbers  were  used  in  the  verification  of  the  model. 

A  sample  output  listing  is  contained  in  Appendix  B. 

Specific  Model  Parameters 

The  task  parameters  used  in  the  model  are  the 
result  of  examining  the  task,  performing  a  literature 
search  to  estimate  reasonable  parameters  and  then  using 
those  parameters  in  the  model.  The  impact  of  those  param¬ 
eters  on  the  complete  simulation  was  then  evaluated  and  a 
sensitivity  analysis  was  performed  to  determine  the  sig¬ 
nificance  of  the  parameters.  If  the  service  of  a  task 
contributed  more  than  10  percent  to  the  total  service  time 
it  was  considered  significant.  These  tasks  were  then 
evaluated  in  more  detail  to  determine  the  most  accurate 
parameters  possible.  This  process  of  parameter  selection 
saved  time  by  not  wasting  effort  on  noncritical  parameter 
investigation  and  enhanced  the  value  of  the  model  by 
ensuring  the  accuracy  of  critical  parameters. 

The  critical  tasks  identified  in  the  process  men¬ 
tioned  above  for  this  model  are  the  aircraft  control  task 
frequencies  and  service  times  and  the  threat  reaction  input 
parameters.  The  service  times  for  the  ECM  tasks  and  the 
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defensive  maneuvers  are  significant,  but  are  more  easily 
defined  than  the  aircraft  control  parameters.  All  task 
parameters  are  presented  in  the  latter  portion  of  this 
chapter  with  short  discussions  of  all  parameters  except 
two  types.  A  more  extensive  discussion  of  defensive 
reaction  input  parameters  is  presented  at  the  end  of  this 
chapter,  while  flight  control  parameters  are  discussed  in 
Chapter  IV. 

Task  Priority  Selection .  All  task  service  priori¬ 
ties  are  based  on  criticality  of  the  task  as  it  relates  to 
the  mission.  Tasks  that  relate  to  aircraft  control  and 
mission  survival  are  ranked  highest,  while  activities  asso¬ 
ciated  with  noncritical  tasks  like  collecting  information 
from  an  alternate  source  are  ranked  the  lowest.  Some  tasks 
have  the  same  priority  for  service  but  are  preemptive 
because  their  immediate  service  is  critical.  For  example, 
the  ECM  task  priority  is  seven  as  is  aircraft  control,  but 
an  aircraft  control  task  will  preempt  an  ECM  task.  Air¬ 
craft  control  is  a  more  urgent  task  because  it  involves  a 
more  immediate  threat  to  life.  The  more  critical  ECM  tasks 
that  relate  to  immediate  survival  enter  the  system  as 
defensive  maneuvers.  Defensive  maneuvers  include  aircraft 
control  and  are  therefore  the  highest  priority  task  in  the 
system  and  they  are  preemptive.  The  remainder  of  the  sys¬ 
tem  tasks  are  based  on  urgency  and  criticality  and  are 
listed  in  Table  II. 
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TABLE  II 


TASK  PRIORITY  AND  SERVICE  SUMMARY 


Task 

Priority 

(Preemptive 

Y/N) 

Mean 

(sec) 

Standard 
Deviation 
( sec) 

Defensive  Maneuver 

9(Y) 

30.0 

5.00 

Turn  to  New  Heading 

8(Y) 

18.0 

9.00 

Aircraft  Control*  (250) 

7  (Y) 

1.426 

1.289 

(500) 

7  (Y) 

1.612 

1.629 

(1000) 

7  ( Y) 

1.509 

1.414 

ECM**  (Interpret  RWR) 

7  (N) 

.6 

.20 

(+ Dispense  Decoy  Material)  7(N) 

1.7 

.96 

(+  Pod  Setting  Change) 

7  (N) 

4.2 

1.05 

Change  IFF 

7  (N) 

6.6 

.76 

Fence  Check 

5  (N) 

20.5 

7.50 

Navigation  Point  Search 

4  (N) 

6.0 

1.50 

Check  INS 

4  (N) 

3 .  C 

.50 

Check  Next  Heading 

4  (N) 

1.8 

.60 

Change  Fuel  Switch 

4  (N) 

1.1 

.76 

Update  INS 

3  (N) 

10.0 

2.00 

Turn  Point  Review 

3  (N) 

6.0 

1.50 

Ops  Check 

3  (N) 

3.0 

.50 

Check  Clock 

3  (N) 

.6 

.20 

Crosscheck  Heading/Course 

3  (N) 

1.8 

.60 

Crosscheck  Altitude 

3  (N) 

1.8 

.60 

Crosscheck  Speed 

2  (N) 

1.8 

.60 

Check  Fuel  Status 

2  (N) 

.6 

.20 

Crosscheck  Compass  System 

KN) 

1.8 

.60 

Crosscheck  Nav  Leg  Distance 

1  (N) 

.6 

.20 

*The  aircraft  control 
vary  with  altitude. 

mean  and  standard  deviation 

**The  ECM  task  service 

time  is  based 

on  the 

level  of 

threat . 
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Task  Parame ter  Selection .  Due  to  the  nature  of  the 
service  times  for  the  tasks  and  the  procedural  repetition 
of  tasks,  the  normal  distribution  was  used  to  input  vary¬ 
ing  parameters  into  the  model.  Specific  task  and  initia¬ 
tion  parameter  selection  is  addressed  below.  All  param¬ 
eters  are  listed  in  units  of  seconds. 

1.  Navigation  Leg  Length 
y  =  420 

a  =  90 

The  desired  leg  length  of  seven  minutes  is 
based  on  the  drift  rate  of  the  INS  used  in  tests  during 
Project  Quick  Look  (Ref  1) .  This  leg  length  is  based  on 
updating  the  INS  at  each  turn  point  to  maintain  the 
required  accuracy  for  the  mission.  The  standard  deviation 
specified  allows  for  the  variability  of  the  distance 
between  good  navigation  update  points. 

2.  Navigation  Search  Repetition 
y  =  240 

o  =  15 

3.  Crosschecks  of  HUD  Displays  With  Cockpit 
Instruments  for  Altitude ,  Speed  and  Heading 

y  =  1.8 

a  =  .6 

These  tasks  require  reading  and  interpreting 
the  HUD  and  an  instrument  to  confirm  the  HUD  information. 
Parameters  are  based  on  the  typical  instrument  interpreta¬ 
tion  times  (Ref  11:15). 
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4 .  Crosschec  of  INS  Pi  splayed  Heading  With 
Navigation  Chart 

P  »  1.8 

o  =  .6 

This  task  involves  interpreting  the  HUD  display 
or  the  course  bearing  pointer  and  comparing  it  to  a  printed 
symbol  on  a  chart.  The  task  is  similar  to  other  cross¬ 
check  activities. 

5.  Navigation  Point  Search  and  Turn  Point  Review 
p  =  6 

o  =  1.5 

These  tasks  involve  the  use  of  navigation  aids 
to  confirm  the  aircraft  position  along  the  route.  The  vari¬ 
ability  is  based  on  the  range  of  difficulty  of  identifying 
some  navigation  cues. 

6 .  Change  IFF  Setting 

P  =  6 .6 

a  =  .76 

This  task  involves  the  manipulation  of  as  many 
as  six  toggle  type  switches  on  an  IFF  control  head.  The 
variability  is  based  on  the  number  of  switches  that  would 
require  manipulation. 

7.  Check  Clock,  Navigation  Leg  Distance  and 
Fuel  State 

p  =  .6 

a  =  .2 

These  parameters  are  based  on  reading  and 
interpreting  an  instrument  or  recorded  symbol  (Ref  11:15). 
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8 .  Crosscheck  of  Heading  System  Witn  Magnetic 
Standby  Compass 

y  =  1.8 

o  =  .6 

This  task  confirms  proper  operation  of  aircraft 
compass  systems  with  a  standby  magnetic  compass.  The  cross¬ 
check  is  similar  to  crosschecks  discussed  earlier. 

9.  Update  INS 
y  =  10 
a=2 

This  task  involves  selecting  predetermined 
geographic  coordinates  in  the  INS  control  head  and  initia¬ 
tion  of  a  system  update.  The  task  time  variability  is 
based  on  the  variation  in  INS  error  at  each  turn  point. 

10.  Check  INS  Accuracy  Between  Updates 
y  =  3 

0  =  .5 

This  task  involves  estimating  INS  accuracy 
from  navigation  cues  along  the  route  when  not  approaching 
a  turn  point.  The  variability  is  based  on  the  variation 
of  INS  error  between  check  points. 

11.  Fuel  Switch  Manipulation 
y  =  1.1 

o  =  .76 

This  task  involves  a  one  time  switch  change 
for  fuel  sequencing  such  as  external  fuel  tank  deselection. 
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The  parameters  are  based  on  typical  toggle  switch  manipula¬ 
tion  (Ref  10:15). 

12.  Fence  Check 

V  =  20.5 

a  =  7.52 

This  task  is  accomplished  prior  to  FEBA  pene¬ 
tration.  The  task  includes  preparing  all  defensive  equip¬ 
ment  for  use  and  turning  off  ail  unnecessary  emitting  equip¬ 
ment  to  reduce  passive  detection  by  the  enemy.  The 
complete  task  requires  the  setting  of  two  rotary  switches 
and  three  toggle  switches.  The  parameters  are  based  on 
summing  typical  service  times  and  standard  deviations 
(Ref  11:15) . 

13.  Systems  Operation  Check  (Ops  Check) 

V  «  3 

a  =  .5 

This  task  involves  the  checking  of  aircraft 
support  systems,  engine  instruments  and  the  malfunction 
telelite  panel.  The  variability  is  based  on  the  number  of 
items  in  the  check. 

14 .  Aircraft  Control  Inputs  and  Service  Times 

Between  Inputs  250/500/1000  Feet  Service  Time 
y  =  1.631/1.746/1.514  =  1.509/1.612/1.462 

a  =  1.692/1.716/1.490  =  1.414/1.629/1.289 

These  are  the  sample  parameters  determined  from 

empirical  data.  The  process  is  fully  explained  in  Chapter 
IV. 
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15.  Turning  to  New  Heading  at  Turn  Points 

V  =  18 

o=9 

This  task  includes  all  aircraft  control  inputs 
while  turning  to  a  new  navigation  heading.  The  aircraft 
is  assumed  to  use  45°  of  bank  and  turn  at  2.5  degrees  per 
second.  The  variability  is  based  on  turn  of  0  to  90  degrees 
in  98  percent  of  all  turns. 

16 .  Defensive  Maneuver 

y  =  30 

o=5 

This  task  involves  maneuvering  the  aircraft  to 
avoid  an  immediate  threat  and  returning  the  aircraft  to  the 
desired  navigation  course.  The  maneuver  length  varies 
with  threat  type  and  terrain. 

17.  Electronic  Countermeasures  Task  Service  Time 


y 

o 

.6* 

.2* 

1.7** 

.96** 

4.2*** 

1.05*** 

Three  service  times  were  required  to  accurately 
model  ECM  service.  Each  service  time  represents  response 
to  a  different  level  of  threat. 

*  RWR  scope  interpretation  only. 

**  RWR  scope  interpretation  and  dispensing 
decoy  material. 

***  RWR  scope  interpretation,  decoy  material 

dispensing  and  ECM  pod  control  panel  switch 
changes. 
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Defensive  Reaction  Task  Initiation  Parameters .  The 
defensive  reaction  tasks  include  ECM  reactions  and  defen¬ 
sive  maneuvers.  The  service  times  of  these  tasks  are  rela¬ 
tively  straightforward  because  they  involve  easily  definable 
activities.  ECM  task  service  is  based  on  recognizing  and 
interpreting  a  threat  indication  on  a  radar  warning 
receiver  (RWR)  and  selecting  the  action  required  to  counter 
the  threat.  These  reactions  include  merely  noting  the 
threat  presence,  the  changing  of  a  setting  on  an  electronic 
countermeasure  pod  control  panel,  the  dispensing  of  decoy 
material  or  any  combination  of  the  above  to  confuse  the 
threat  system.  The  defensive  maneuver  task  is  initiated  by 
the  same  recognition  and  interpretation  procedure  or  some 
external  visual  threat  sighting.  This  task  involves  maneu¬ 
vering  the  aircraft  to  avoid  a  projectile  or  evade  the 
radar  tracking  system  by  terrain  masking.  Task  service 
includes  the  time  associated  with  returning  to  a  desired 
navigation  heading  and  altitude  after  defensive  maneuver 
completion. 

Service  times  for  each  defensive  reaction  task 
did  not  vary  between  mission  profiles  in  the  thesis.  The 
frequency  of  tasking  did  vary  between  profiles.  Defensive 
reaction  task  initiation  was  based  on  associating  a  threat 
rate  with  each  leg  of  the  mission.  That  is,  each  leg  had 
a  unique  distribution  for  threat  reactions.  The  threat 
rate  was  based  on  the  first  two  mission  legs  being  in 
friendly  territory  and  the  remaining  legs  in  enemy  territory . 
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The  third  leg  of  the  mission  included  the  FEBA  penetration 
(see  Figure  6).  The  same  defensive  reaction  input  dis¬ 
tribution  was  used  for  respective  legs  of  each  profile 
except  for  the  third  leg.  Defensive  reaction  input  reduc¬ 
tion  with  lower  altitudes  was  modeled  by  not  allowing  all 
initiated  tasks  to  reach  the  queue.  The  ratio  of  queued 
tasks  to  those  initiated  was  developed  by  determining  the 
ratios  of  threat  reactions  required  at  different  altitudes 
using  the  threat  array  discussed  below.  A  Monte  Carlo 
technique  using  this  ratio  was  then  used  to  determine  which 
tasks  proceeded  to  the  queue. 

A  defensive  task  initiation  rate  was  also  based 
on  the  results  of  a  threat  array  investigation.  The  inves¬ 
tigation  used  a  model  and  array  developed  by  Leek  and 
Schmitt  (Ref  4)  for  a  course  project  in  an  advanced  simu¬ 
lation  course  at  the  Air  Force  Institute  of  Technology. 

The  array  was  developed  from  unclassified  sources  and  was 
used  to  model  the  penetration  of  a  Soviet  Army  on  the  For¬ 
ward  Edge  of  the  Battle  Area  (FEBA)  by  a  single  aircraft. 
Figure  7  shows  the  threat  array  and  flight  corridor  used 
to  draw  data.  The  model  output  gave  the  probability  of 
kill  (P^)  of  a  single  aircraft  for  each  weapon  site  in  the 
array.  These  P^'s  were  based  on  radar  detection  and  track¬ 
ing  equations  using  a  representative  aircraft  cross-section 
and  representative  threat  system  capabilities. 

The  threat  model  was  run  twenty  times  for  each  of 
three  altitudes  to  build  a  reasonable  data  base  of  P^'s. 


The  resulting  ' s  were  then  examined  to  determine  initia¬ 
tion  rates  of  each  type  ECM  task.  If  a  threat  was 
greater  than  .01,  it  was  accepted  as  an  input  into  the 
system.  This  level  of  threat  required  an  interpretation 
of  the  RWR  scope  as  a  minimum  task.  A  P^  greater  than  .1 
but  less  than  .2  was  assigned  the  task  of  dispensing  decoy 
material  and  normal  ECM  pod  operation  (no  pod  control  panel 
manipulation  required)  to  confuse  the  threat  radar  system. 
Pk' s  greater  than  or  equal  to  .2  but  less  than  .3  required 
dispensing  decoy  material  and  changing  the  ECM  pod  setting. 
Defensive  maneuvers  were  required  for  all  P^'s  greater  than 
or  equal  to  .3.  The  selection  of  .01,  .1,  .2  and  .3  as 
task  change  points  was  a  subjective  decision  based  on  the 
authors'  operational  experience  in  the  ECM  environment. 

A  summary  of  the  raw  data  from  the  threat  array  investiga¬ 
tion  is  contained  in  Appendix  D. 

The  time  between  threat  reaction  tasks  and  the 
number  of  tasks  initiated  was  developed  by  examining  the 
threat  range  limited  by  the  aircraft  altitude  and  the 
threat  location  in  the  FEBA  array.  The  rate  of  encounter¬ 
ing  each  threat  system  was  determined  by  using  a  profile 
view  of  the  FEBA  array  that  depicted  the  threat  locations 
and  the  system  ranges  (adjusted  for  aircraft  altitude) . 

The  leading  edge  of  each  threat  envelope  was  then  marked 
and  the  distance  between  each  leading  edge  was  determined. 
Figure  8  shows  a  basic  representation  of  this  process  for 
an  aircraft  at  1000  feet  AGL.  These  distances  were  then 
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Fig.  8.  Profile  View  of  FEBA  Array 


transformed  into  time  based  on  an  aircraft  speed  of  360 
knots.  The  resulting  times  were  used  to  fit  an  exponential 
distribution  for  each  altitude  profile.  The  duration  of 
the  FEBA  threat  exposure  (X  in  Figure  8)  was  deter¬ 

mined  by  using  the  same  figure  to  determine  the  time 
between  entry  into  the  first  threat  envelope  and  exit  of 
the  last  envelope.  This  duration  was  used  in  the  network 
model  to  terminate  the  high  threat  level  associated  with 
the  FEBA.  Table  III  is  a  summary  of  the  input  rates,  dura¬ 
tions  and  expected  numbers  of  threats  requiring  inputs  in 
the  FEBA.  An  exponential  distribution,  with  the  parameters 
in  Table  III  was  used  to  input  defensive  reaction  tasks. 


TABLE  III 


FEBA 

THREAT 

INPUT 

PARAMETERS 

Altitude 
(Feet  AGL) 

Input  Rate 

Duration 
( sec) 

Expected 
Number  * 

1000 

X 

=  20 ;  s 

=  20 

210 

10.5 

500 

X 

=  20 ;  s 

=  20 

180 

9.0 

250 

X 

=  12;  s 

=  12 

90 

7.5 

*These  expected  numbers  are  the  initiated  tasks, 
not  the  queued  tasks.  Queued  tasks  at  500  feet  =  .68  x 
9.0  =  6.32.  Queued  tasks  at  250  feet  =  .33  x  7.5  =  2.5. 


The  shorter  mean  at  250  feet  seemed  unusual  upon 
first  examination,  but  further  study  indicated  that  it  was 
reasonable.  This  was  most  easily  shown  by  using  a  set  of 
two  diagrams  of  two  different  threat  systems  at  each  of 
two  locations.  Figure  9  graphically  shows  the  effects  of 
reduced  threat  range  at  lower  altitudes.  As  Figure  9 
shows,  the  mean  time  between  threat  envelope  encounters 
was  smaller  at  the  lower  altitude. 

Model  Computerization 

The  simulation  language  SLAM  was  used  to  computer¬ 
ize  the  model  because  it  offered  inherent  network  simula¬ 
tion  structure  and  time  sequencing  of  events.  The  SLAM 
language  also  allowed  the  use  of  subroutines  written  in 
FORTRAN  for  discrete  event  simulations  and  selection  of 
output  parameters  and  formats  to  suit  the  needs  of  the 
study.  Although  the  continuous  capability  of  SLAM  was  not 


Fig.  9.  Comparison  of  Threat  Encounter  Rates 
for  Two  Different  Altitudes 


used  in  this  study  the  growth  potential  it  provides  for 
the  model  and  this  study  are  very  desirable. 

The  network  diagrams  for  the  model  and  the  flow 
charts  for  the  subroutines  are  presented  in  Appendix  A. 
The  SLAM  program  coding  is  listed  in  Appendix  B.  Code 
documentation  and  explanations  of  coding  steps  are  con¬ 
tained  in  the  SLAM  listing  through  the  use  of  comment 
statements . 


Model  Validation 

Model  validation  is  the  process  of  demonstrating 
that  the  model  results  duplicate  the  actual  system  results. 
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Since  this  model  was  designed  to  produce  interval  data 
for  comparative  purposes,  validation  was  not  a  critical 
factor  in  this  study.  Validation  methods  that  could  be 
used  are  addressed  next. 

Direct  physical  validation  of  this  model  is  impos¬ 
sible  because  the  instrumentation  required  to  document  the 
real  system  could  not  be  placed  in  a  single  cockpit  air¬ 
craft.  A  less  detailed  validation  could  be  accomplished 
by  closely  observing  a  pilot  in  a  sophisticated  simulator. 
The  simulator  mission  could  be  patterned  after  a  particular 
run  of  the  model  with  the  same  leg  lengths  and  threat 
inputs  in  order  to  give  a  comparable  profile.  The  model 
results  could  then  be  compared  with  the  simulator  results. 
This  less  detailed  validation  would  still  be  limited  by 
the  lack  of  risk  associated  with  simulators  and  the  lack 
of  mission  realism.  Current  tactical  aircraft  simulators 
lack  the  sophistication  necessary  to  accomplish  this  valida¬ 
tion.  Face  validity  of  the  model  is  possible  by  examining 
the  model  output.  The  output  is  reasonable  in  the  opinion 
of  three  tactical  aviation  pilots  who  examined  the  model 
results  (Ref  3) . 

Model  Verification 

Model  verification  is  the  process  of  demonstrating 
that  the  model  mechanically  performs  as  designed.  The 
process  is  necessary  to  establish  confidence  in  the  model 
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results.  Verification  is  especially  important  in  this 
study  since  validation  was  not  possible. 

Model  verification  was  accomplished  in  four  steps. 
The  first  step  involved  the  confirmation  that  the  distribu¬ 
tions  used  in  the  simulation  provided  the  desired  input 
data  (Appendix  C) .  The  second  step  was  tracing  the  opera¬ 
tion  of  the  model  through  one  complete  run  to  confirm 
proper  mechanical  operation  of  the  model.  The  next  step 
involved  checking  the  model  operation  when  limiting  param¬ 
eters  were  used  as  inputs.  One  run  was  made  with  all 
service  times  set  equal  to  zero  to  confirm  the  resulting 
service  time  would  be  zero  and  no  tasks  would  fail  to  be 
accomplished.  A  second  run  with  all  service  times  set  at 
the  mission  length  confirmed  that  no  tasks  were  completed 
and  the  server  was  always  occupied.  Partial  runs  were  also 
accomplished  with  parameters  that  allowed  the  confirmation 
of  the  stress  scheme  and  the  preempt  capability  of  the 
model.  The  final  verification  step  was  the  inclusion  of 
checks  in  each  run  of  the  model  that  indicated  which  tasks 
if  any  were  not  being  accomplished.  This  final  step 
insured  accurate  data  collection  for  each  profile  of  the 
model . 

The  purpose  of  this  chapter  was  to  describe  the 
model  and  the  model  parameters  so  a  reader  could  establish 
confidence  in  the  resulting  data.  This  chapter  should  also 
provide  a  background  for  further  studies  in  this  area.  The 


next  chapter  contains  a  description  of 
parameter  development  process. 
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I 


Flight  Control  Movements 


For  this  study  the  assumption  was  made  that  flight 
control  movements  were  an  integral  part  of  pilot  workload 
for  a  low-level  navigation  mission.  Little  research  has 
been  done  on  the  subject.  The  lack  of  research  on  the  tech¬ 
nique  of  measuring  pilot  workload  by  interpreting  flight 
control  movements  was,  in  part,  due  to  the  complexness  of 
such  an  undertaking.  A  data  base  which  would  describe  the 
expected  frequency  of  movement  of  the  flight  controls  for 
a  given  aircraft  in  every  flight  condition  over  all  ranges 
of  the  aircraft's  flight  envelope  would  be  an  unnecessary 
if  not  an  impossible  task.  However,  for  specified  flight 
conditions,  knowing  the  flight  control  movements  required 
by  an  average  pilot  to  fly  a  particular  type  aircraft  over 
given  terrain  at  specific  altitudes  would  serve  as  a  base 
from  which  to  begin  to  measure  pilot  workload  in  a  speci¬ 
fied  environment. 

Basic  control  of  an  aircraft  is  accomplished  by  a 
pilot  through  manipulation  of  the  primary  aircraft  controls; 
the  stick,  throttles,  and  rudder.  All  movements  of  an  air¬ 
craft  desired  by  a  pilot  are  controlled  by  movements  or 
combinations  of  movements  of  these  controls.  A  data  base 
which  captures  the  distributions  of  periods  of  control 
movement  and  non-movement  for  an  average  pilot  over  a 
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defined  course  in  a  specific  aircraft  would  provide  a  foun¬ 
dation  from  which  to  study  pilot  workload  from  the  viewpoint 
of  pilot  tasks. 

No  data  base  of  flight  control  movements  in  the 
night  low  altitude  environment  existed  in  the  form  which 
was  required  for  the  technique  of  modeling  proposed  in  this 
thesis.  The  A-10,  LANTIRN  simulator  at  the  Wr ight-Patterson 
AFB  Crew  Station  Design  facility  provided  a  source  from 
which  to  gather  the  necessary  data.  With  it,  a  data  base 
was  established  which  did  describe  the  frequency  of  control 
movements  and  non-movements  in  a  simulated  electro-optical 
night  environment. 

The  objective  of  the  experiment  was  to  obtain  data 
from  which  frequency  of  flight  control  movements  and  non¬ 
movements  could  be  developed.  Four  pilots  were  selected  to 
fly  the  simulator.  However,  due  to  a  malfunction  in  the 
data  collection  mechanism,  data  from  the  flights  of  the 
fourth  pilot  could  not  be  used.  The  pilots  had  a  fighter 
background  with  the  experience  shown  in  Table  IV.  They  all 
had  experience  flying  in  the  low-altitude  environment. 
Although  the  pilots  had  previously  flown  the  A-10  cockpit 
design  simulator,  none  had  done  any  actual  flying  for  one 
year  prior  to  the  experiment.  Prior  to  gathering  data, 
each  pilot  was  given  30  to  45  minutes  to  practice.  At 
the  end  of  the  practice  period  all  felt  very  comfortable 
controlling  the  simulator.  The  data  was  gathered  while 
flying  a  route  not  flown  during  the  practice  session  which 
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TABLE  IV 


PILOT  EXPERIENCE 


Pilot 

F-4 

T-38 

A 

2100  hrs 

125  hrs 

Pilot 

B 

F-4 

F-5 

T-38 

725  hrs 

1250  hrs 

1250  hrs 

Pilot 

C 

EC-47 

F-100 

A-7D 

OV-10 

950  hrs 

550  hrs 

1100  hrs 

400  hrs 

consisted  of  combinations  of  flat  and  hilly  terrain.  The 
maximum  tops  of  the  hills  were  approximately  3000  feet 
above  the  surrounding  terrain.  The  route  contained  five 
legs  and  four  turn  points  (Figure  10) .  The  lengths  of  the 
legs  were  14,  12,  6,  7,  and  27  nautical  miles  respectively. 
All  turns  were  to  the  left  and  were  34°,  22°,  102°,  and  62° 
respectively.  The  pilots  maintained  a  constant  power 
setting  (full  throttle)  and  the  airspeed  was  allowed  to 
vary  between  350  and  450  knots  depending  on  the  rise  and 
fall  of  the  terrain.  Power  was  kept  constant  and  the  air¬ 
speed  was  allowed  to  vary  because  time  between  turn  points 
was  not  critical.  In  the  actual  combat  environment  pilots 
would  be  navigating  with  an  inertial  navigation  system  and 
following  the  directions  it  provided.  Therefore,  precise 
timing  on  the  route  was  not  necessary. 

The  simulator  was  equipped  with  a  HUD  similar  to 
that  which  will  be  used  on  LANTRIN-equipped  aircraft.  A 
test  pilot  who  had  flown  the  simulator  and  aircraft 
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modified  with  forward  looking  infra-red  (FLIR)  displays, 
was  quoted  by  the  crew  station  design  personnel  as  having 
said,  "The  visual  presentation  of  the  simulator  closely 
approximated  the  real  FLIR  presentation." 

The  terrain  forward  of  the  aircraft  was  presented 
on  the  HUD.  Cues  were  also  presented  on  the  HUD  which  indi¬ 
cated  altitude  above  the  terrain,  airspeed,  heading,  and 
the  pitch  changes  which  were  required  to  maintain  the 
desired  altitude  above  the  terrain.  Because  the  objective 
of  the  experiment  was  to  determine  the  flight  control  move¬ 
ments  necessary  to  fly  the  specified  course,  no  extraneous 
tasks  were  presented  to  the  pilots.  The  only  mission  each 
had  was  to  fly  the  simulator  by  following  the  visual  picture 
of  the  terrain  and  the  cues  presented  to  him  on  the  HUD. 

The  data  gathering  runs  were  made  while  the  pilots 
flew  the  course  first  at  1000  feet  followed  by  500  feet 
and  250  feet.  Each  mission  required  approximately  ten 
minutes  to  complete.  During  each  run,  data  was  gathered  at 
tenth  of  a  second  intervals.  The  data  gathered  were: 

(1)  stick  position  in  pitch  and  bank,  (2)  throttle  position, 
(3)  rudder  position,  (4)  trim  button  position,  (5)  latitude 
and  longitude,  (6)  altitude  mean  sea  level,  (7)  altitude 
above  the  terrain,  and  (8)  airspeed.  All  data  was  recorded 
on  tape  in  a  form  compatible  with  a  Control  Data  Corporation 
CDC  6600  computer. 
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All  data  was  reviewed  for  completeness  by  examining 
plots  of  runs  and  reading  cross-sections  of  printouts  of 
recorded  data  prior  to  analyzing  it.  In  the  analysis  it 
was  found  that  rudder  and  throttle  movements  were  insigni¬ 
ficant  inputs  in  the  control  of  the  aircraft  in  this  experi 
ment.  All  pilots  stated  that  throttles  and  the  rudder  were 
not  moved.  This  was  confirmed  by  observation  of  a  cross- 
section  of  printouts  from  the  data.  Neither  of  these 
facts  was  a  surprise;  throttles  were  not  moved  because  a 
constant  power  setting  was  briefed  prior  to  the  mission 
and  rudders  were  not  used  because  the  type  of  maneuvering 
exhibited  in  the  experiment  did  not  require  rudder  coordina 
tion.  The  trim  control  was  used  very  little;  an  average 
of  eight  to  ten  times  based  on  the  observed  runs.  The 
control  inputs  required  to  fly  the  aircraft  on  the  speci¬ 
fied  profiles  did  not  require  an  extensive  number  of  trim 
control  inputs.  Trim  control  as  an  input  to  workload  for 
this  thesis  was  dropped  from  consideration  for  two  reasons; 
it  was  used  very  little  during  the  flights  and  trim  was 
normally  used  in  conjunction  with  control  stick  movements. 
Therefore,  only  the  pitch  and  bank  control  movements  were 
analyzed . 

The  definition  of  stick  movement  for  this  thesis 
was;  a  control  stick  movement  forward  or  aft,  left  or  right 
or  any  combination  of  forward  or  aft,  and  left  or  right 
movements.  Stick  position  was  recorded  as  a  voltage. 


Forward  and  aft  movements  were  defined  betv/een  +6.0  volts 
and  -6.0  volts  with  +  indicating  the  aft  stick  position. 

Left  and  right  movements  were  indicated  by  voltages 
between  +3.25  volts  and  -3.25  volts;  +  indicated  a  right 
movement  of  the  stick.  The  position  of  the  control  stick 
was  defined  by  voltages  measured  to  .01  volts;  however, 
noise  in  the  system  was  +.02  volts. 

It  was  necessary  to  define  movement  in  terms  of 
the  voltages  so  that  a  FORTRAN  program  (Appendix  E)  could 
be  written  and  used  to  extract  the  data  which  described 
the  movement  and  non-movement  periods.  Because  noise  was 
present  in  the  system  movement  of  the  stick  could  not  be 
accurately  detected  by  looking  for  differences  in  each  con¬ 
secutive  voltage.  The  noise  gave  erroneous  indications  of 
movement  and  biased  the  periods  of  movement  and  non¬ 
movement.  To  dampen  the  noise  in  the  system,  movement  was 
determined  by  a  stick  position  voltage  being  outside  a  base 
position.  The  base  position  was  an  interval  of  .04  volts 
in  pitch  and  bank  that  defined  where  the  stick  position 
had  to  be  if  no  movement  of  the  control  stick  was  to  be 
recorded.  A  new  base  position  was  set  each  time  each  of  the 
voltages  over  a  period  of  six  tenths  of  a  second  was  less 
than  the  average  of  the  six  voltages  ±.02  volts.  The  pro¬ 
gram  individually  checked  the  pitch  and  bank  positions  at 
each  time  period  of  one  tenth  second  to  determine  if  the 
stick  was  moving  in  pitch  or  bank.  As  an  example,  if  the 
time  was  T(now)»  prior  to  checking  the  control  stick  bank 
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position  voltage,  the  program  looked  forward  six  tenths  of 
a  second  and  averaged  the  voltages. 


V 

ave 


1 

6 


6 

1  V[T  .] 
1=1  1  now+i 


where 

T  =  Time  now; 
now 

V  =  Voltage;  and 
Vave  =  Average  Voltage. 

If  any  of  the  voltage  in  the  six  tenth  second  interval  was 
greater  than  V  +.02  volts,  the  base  was  not  reset.  If 
all  the  voltages  within  the  interval  were  within  the  inter¬ 
val  of  V  ±.02  the  base  was  reset  to  the  new  interval, 
ave 

V.  .  was  then  compared  to  the  base  interval,  if  it  was 
'now* 

within  the  base  interval  the  stick  was  not  moving;  if  it 
was  not  within  the  interval  the  stick  was  moving.  As  men¬ 
tioned  earlier,  if  either  the  pitch  or  bank  was  moving  the 
time  period  was  classified  as  moving.  Figure  11  shows  two 
hypothetical  base  positions  within  the  total  movement  area 
of  the  stick  {not  drawn  to  scale) .  It  depicts  more  vividly 
the  position  the  stick  must  be  in  for  there  to  be  no  indica¬ 
tions  of  movement;  both  pitch  and  bank  voltages  must  be 
within  the  intervals  which  define  the  base  "Box;"  if  either 
is  outside  the  box  the  program  senses  a  movement. 

The  interval  of  six  tenths  of  a  second  was  chosen 
as  the  period  for  establishing  a  new  base  because  any  time 
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Fig.  11.  Stick  Movement  Base  Position 
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period  less  than  that  could  mask  a  movement  of  the  stick  in 
noise;  a  smooth  stick  movement  over  a  five  tenth  of  a 
second  time  period  could  go  from  -.02  volts,  through  -.01, 
00,  +.01  to  +.02  volts.  The  average  of  the  five  would  be 
0  and  all  voltages  would  be  within  the  +.02  volt  interval. 
When  the  interval  was  extended  to  six  tenths  of  a  second 
the  movement  would  either  start  from  a  position  outside 
the  interval  or  end  in  a  position  outside  the  interval  and 
would  not  be  classified  as  a  movement. 

As  the  program  stepped  through  each  time  period  it 
recorded  the  movements  and  non-movement  periods.  If  a 
change  was  detected  and  confirmed  the  period  of  time  of 
the  condition  prior  to  the  change  was  recorded  and  a  new 
interval  was  started.  The  program  must  have  seen  a  trend 
of  at  least  3  tenths  of  a  second  before  a  change  was 
recorded.  If  a  trend  for  a  change  from  movement  to  non¬ 
movement  was  noted  and  on  the  third  sequential  period  the 
voltage  indicated  movement,  the  previous  2  tenths  of  a 
second  period  of  non-movement  was  classified  as  noise  and 
simply  treated  as  a  period  of  movement. 

Any  period  of  change  less  than  three  tenths  of  a 
second  was  treated  as  noise  for  two  reasons:  (1)  no  normal 
control  movement  or  non-movement  of  two  tenths  of  a  second 
would  have  an  effect  on  the  movement  of  the  aircraft, 
and  (2)  noise  would  cause  frequent  one  and  two  tenths  of 
a  second  excursions  which  would  bias  the  distributions. 

The  program  was  designed  to  sense  the  pulsing  type  stick 
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movements  that  are  encountered  in  this  environment.  Smooth 


movements  such  as  the  type  a  pilot  would  use  in  instrument 
flying  would  tend  to  be  dampened.  An  example  of  this 
dampening  is  shown  in  the  verification  run  (Appendix  F) . 

Verification  of  the  program  was  conducted  with  two 
lists  of  numbers,  one  for  the  pitch  and  one  for  the  bank 
distribution  direction  (Appendix  F) .  Each  of  the  lists 
was  voltages  which  defined  known  stick  movements  and  rest 
periods  for  pitch  and  bank.  The  program  was  modified  with 
print  statements  to  track  the  course  of  the  numbers  in  the 
program  as  each  was  tested.  All  changes  of  the  pitch  and 
bank  bases  were  also  tracked.  The  program  detected  and 
recorded  the  pre-selected  distributions  of  movements  and 
non-movements.  To  verify  that  the  program  could  detect 
either  pitch  movements  or  bank  movements,  the  pitch  string 
of  numbers  was  modified  to  remove  one  of  the  movements  and 
the  bank  string  was  not  changed.  The  program  was  run  using 
the  modified  string;  all  stick  movements  were  detected. 

The  same  modification  was  made  on  the  bank  string  and  the 
pitch  string  was  not  modified.  The  program  was  run  and  all 
movements  were  recorded  which  verified  that  the  program  did 
detect  all  movements  and  accurately  recorded  each. 

Because  only  data  from  straight-line  flight  was 
desired,  not  all  data  that  was  recorded  was  used.  Data 
recorded  at  turn  points  was  not  used  to  develop  the  dis¬ 
tributions.  Figure  12  depicts  the  blocks  in  which  data 
was  read  and  analyzed.  With  a  few  exceptions,  only 
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Fig.  12.  Blocks  where  Data  are  Analyzed 


straight-line  flight  was  analyzed.  Worklo’d  during  the 
turns  was  treated  as  a  separate  function  in  the  SLAM  pro¬ 
gram.  Therefore,  including  turns  in  the  development  of  the 
distributions  would  have  biased  the  overall  analysis  by 
double  counting  the  work  in  the  turns. 

There  were  two  sources  of  error  in  the  program; 
neither  significantly  affected  the  distributions.  The 
first  occurred  at  the  start  of  each  run.  The  program 
allowed  noise  to  enter  during  the  development  of  the  first 
time  interval;  it  made  no  difference  if  the  interval  was  a 
movement  or  a  non-movement.  It  was  probable  that  the  pro¬ 
gram  would  begin  in  the  middle  of  an  interval  of  movement 
or  non-movement.  The  result  was  the  interval  recorded 
would  not  reflect  the  true  interval.  Using  the  argument 
that  the  longest  interval  recorded  during  the  experiment 
was  13.9  seconds  and  the  average  time  of  the  recorded  por¬ 
tion  of  each  run  was  4,700  seconds,  the  maximum  probable 
error  for  the  problem  was  less  than  .3  percent. 

The  second  source  of  error  was  twofold.  At  the 
beginning  of  each  run  the  base  was  assumed  to  be  within  the 
interval  ±.02  volts;  until  the  base  was  reset  all  voltages 
were  compared  with  that  base.  Also,  when  the  first  voltage 
checked  in  a  run  indicated  movement  and  the  second  voltage 
checked  indicated  no  movement,  the  first  was  recorded  as  a 
period  of  one  tenth  of  a  second  of  movement.  This  also  was 
not  significant  and  produced  errors  of  no  more  than  .02 
percent. 
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Results 


Table  V  depicts  the  statistical  results  of  each 
run.  Appendix  G  contains  the  histograms  for  all  runs. 

Each  distribution  had  large  standard  deviations  caused  by 
a  few  large  excursions  in  movements  and  non-movements. 

The  excursions  were  due  to  the  non-homogeneous  terrain  over 
which  the  data  was  collected.  The  sample  distributions  did 
not  appear  to  be  from  any  published  distribution.  A  basic 
attempt  to  curve  fit  a  few  of  the  distributions  to  gammas 
and  exponentials  was  made;  however,  because  of  the  lack  of 
success  to  curve  fit  the  distributions  and  the  fact  that 
empirical  data  was  satisfactory  for  input  to  the  low-level 
navigation  model  no  curve  fitting  was  done. 

The  Friedman  two-way  ANOVA  by  ranks  test  (Ref  12: 
166)  and  the  Kolmogorov-Smirnov  two-sample  test  (Ref  12: 
127)  were  used  to  determine  the  probability  that  related 
distributions  were  from  the  same  population.  Because  the 
Friedman  two-way  ANOVA  was  quite  robust,  the  Kolmogorov- 
Smirnov  test  was  used  to  confirm  the  results  of  the  Freid- 
man  test . 

Four  Friedman  tests  were  performed;  two  for  move¬ 
ments  and  two  for  non-movements.  The  first  tested  whether 
or  not  the  mean  movements  for  a  pilot  at  all  altitudes  were 
from  the  same  population  as  the  mean  movements  of  the  other 
pilots  at  all  altitudes .  Table  VI  shows  the  arrangement 
for  the  test. 
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TABLE  V 

PILOT  STATISTICS 


1000  FEET 

Stick 

Movements 

No  Stick 

Movements 

Mean 

Std  Dev 

Mean 

Std  Dev 

Pilot 

A 

1.327  sec 

1.403  sec 

1.676  sec 

1.881  sec 

Pilot 

B 

1.559  sec 

1.544  sec 

1.556  sec 

1.620  sec 

Pilot 

C 

1.655  sec 

1.253  sec 

1.665  sec 

1.551  sec 

600  FEET 

Stick 

Movements 

No  Stick 

Movements 

Mean 

Std  Dev 

Mean 

Std  Dev 

Pilot 

A 

1.081  sec 

1.030  sec 

2.077  sec 

1.967  sec 

Pilot 

B 

2.126  sec 

2.137  sec 

1.717  sec 

1.768  sec 

Pilot 

C 

1.680  sec 

1.403  sec 

1.413  sec 

1.246  sec 

250  FEET 

Stick 

Movements 

No  Stick 

Movement  s 

Mean 

Std  Dev 

Mean 

Std  Dev 

Pilot 

A 

1.137  sec 

9.888  sec 

1.605  sec 

1.571  sec 

Pilot 

B 

1.764  sec 

1.524  sec 

1.211  sec 

1.119  sec 

Pilot 

C 

1.398  sec 

1.245  sec 

1.721  sec 

1.674  sec 
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TABLE  VI 


FRIEDMAN  TWO-WAY  ANOVA  BY  RANKS;  ALTITUDE 


Pilot  1 

Pilot  2 

Pilot  3 

ALT 

1000 

1.327 

1.559 

1.655 

ALT 

500 

1.081 

2.126 

1.680 

ALT 

250 

1.137 

1.763 

1.398 

The  Friedman  Test  tested  Hq :  that  all  columns  were 
from  the  same  population.  The  results  showed  that  there 
was  a  probability  of  .194  that  the  columns  of  means  came 
from  the  same  population.  The  Friedman  test  was  used  to 
test  the  non-movement  means  in  the  same  manner.  The  proba¬ 
bility  that  Hq:  the  columns  of  means  of  non-movements  were 
from  the  same  population,  was  true  was  .361.  Both  indi¬ 
cated  that  there  was  a  low  probability  that  the  distribu¬ 
tions  of  the  means  of  each  pilot  were  from  the  same  popula¬ 
tion  as  the  other  pilots.  Table  VII  shows  the  arrangement 
which  was  used  to  test  if  the  means  of  the  movements  of 
pilots  at  each  altitude  were  from  the  same  population. 


TABLE  VII 

FRIEDMAN  TWO-WAY  ANOVA  BY  RANKS;  PILOT 


1000  FT 

500  FT 

250  FT 

Pilot 

1 

1.327 

1.081 

1.137 

Pilot 

2 

1.559 

2.126 

1.764 

Pilot 

3 

1.655 

1.680 

1.398 

The  test  indicated  Hq :  the  means  of  the  distribu¬ 
tions  of  movements  of  pilots  at  each  altitude  were  from 
the  same  population,  was  true  with  a  probability  of  .944. 
Testing  the  non-movements  using  Hq:  the  means  of  the  dis¬ 
tributions  of  non-movements  of  pilots  at  each  altitude 
were  from  the  same  population,  indicated  that  the  proba¬ 
bility  that  Hq  was  true  was  also  .944.  Because  the 
Friedman  test  is  very  robust  and  little  is  known  about  the 
power  of  the  test,  more  statistical  comparisons  of  the  dis¬ 
tributions  were  made  using  K-S  two-sample  tests.  The  K-S 
two-sample  test  was  used  to  test  the  null  hypothesis  that 
the  two  distributions  being  tested  were  from  the  same 
population.  The  two-tailed  probability  that  Hq  was  true 
was  recorded  for  all  the  combinations  of  movement  distribu¬ 
tions  between  pilots  at  each  altitude  and  then  between 
altitudes  for  each  pilot.  The  same  tests  were  conducted 
using  the  non-movement  distributions.  See  Appendix  H  for 
the  results  of  the  test. 

The  results  indicate  that  there  are  greater  proba¬ 
bilities  of  distributions  being  from  the  same  population 
for  a  pilot  at  the  three  different  altitudes  than  between 
pilots  at  the  same  altitude.  Figures  13  through  17  show 
this-  more  graphically.  Little  difference  can  be  seen  between 
the  pitch  and  bank  movements  as  Pilot  A  changes  altitudes. 
However,  a  definite  difference  can  be  seen  between  Pilots 
A,  B,  and  C  at  1000  feet.  The  unexpected  finding  indi¬ 
cated  there  was  little  difference  in  pilot  workload  due 
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PILOT  A  1000  FEET 


Profile  of  Pilot  A,  1000  Feet 
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to  movement  of  flight  controls  for  the  low-level  flights 
in  the  three  altitude  blocks. 

It  appears  the  reason  for  the  lack  of  difference 
between  flight  control  movements  at  the  various  altitudes 
is  twofold.  The  amount  of  vertical  movement  of  the  air¬ 
craft  was  similar  for  each  altitude  block.  Because  the 
terrain  over  which  the  route  was  flown  was  quite  flat 
between  hills,  flying  at  a  lower  altitude  did  not  increase 
the  number  of  hills  that  affected  the  flight  path  of  the 
aircraft.  Or,  stated  another  way,  the  three-thousand-foot 
hills  or  mountains  had  very  close  to  the  same  affect  on 
the  required  vertical  movement  of  an  aircraft  at  1000  feet 
AGL  as  they  had  on  an  aircraft  at  250  feet  AGL.  The  second 
factor  was  that  the  pilots  were  following  a  pitch  director 
which  gave  indications  when  to  raise  and  lower  the  nose 
of  the  aircraft  to  avoid  the  terrain  by  the  specified 
amount.  The  cues  tended  to  dampen  the  effects  of  the 
terrain  by  starting  pitch  changes  in  approximately  the 
same  locations  prior  to  the  hills. 

Further  study  was  done  to  confirm  the  aircraft 
altitudes  for  each  run.  This  was  necessary  to  show  that 
the  aircraft  were  at  the  specified  altitudes.  All  were 
within  the  specified  altitudes  for  the  majority  of  the  time 
on  each  run.  Table  VIII  indicates  the  amount  of  time  that 
was  spent  in  various  altitude  bands  for  each  run.  It  also 
shows  that  the  aircraft  on  each  run  was  at  the  altitude 
specified  for  the  majority  of  time. 


TABLE  VIII 


ALTITUDE  (AGL)  FOR  EACH  RECORDED 
PORTION  OF  A  RUN 


TENTHS  OF  SECONDS 

1000  FEET 

500  FEET 

250  FEET 

PILOT  A 

Less  than  150  feet 

0 

1 

6 

150  feet  to  350  feet 

0 

11 

1972 

351  feet  to  650  feet 

0 

2409 

1878 

651  feet  to  1350  feet 

2879 

2001 

623 

Greater  than  1350  feet 

1878 

174 

224 

200  feet  to  300  feet 

0 

0 

965 

450  feet  to  550  feet 

0 

935 

532 

950  feet  to  1050  feet 

737 

226 

73 

PILOT  B 

Less  than  150  feet 

0 

0 

171 

150  feet  to  350  feet 

0 

122 

1804 

351  feet  to  650  feet 

80 

2258 

1948 

651  feet  to  1350  feet 

3477 

2013 

772 

Greater  than  1350  feet 

1375 

287 

32 

200  feet  to  300  feet 

0 

70 

1095 

450  feet  to  550  feet 

38 

1022 

542 

950  feet  to  1050  feet 

698 

247 

105 

PILOT  C 

Less  than  150  feet 

25 

22 

60 

150  feet  to  350  feet 

71 

126 

1616 

351  feet  to  650  feet 

179 

1677 

1864 

651  feet  to  1350  feet 

2785 

2462 

1070 

Greater  than  1350  feet 

1648 

329 

301 

200  feet  to  300  feet 

34 

79 

998 

450  feet  to  550  feet 

50 

755 

531 

950  feet  to  1050  feet 

625 

325 

86 

69 


As  mentioned  earlier,  the  objective  of  the  experi¬ 
ment  was  to  develop  distributions  of  movement  and  non¬ 
movement  of  flight  controls  for  the  low-level  navigation 
model.  Figures  18  through  20  show  the  average  distributions 
which  were  developed  by  combining  the  data  from  all  three 
pilots  at  each  altitude.  Each  depicts  the  cumulative  dis¬ 
tribution  and  the  probability  density  function  for  stick 
movements  and  non-movements  at  each  altitude.  How  they 
were  used  was  described  in  Chapter  III.  The  statistical 
data  for  the  distributions  is  in  Table  IX. 

It  must  be  remembered  that  the  distributions  were 
developed  from  a  simulated  flight.  The  pilots  used  in  the 
experiment  were  not  proficient  in  low-level  navigation 
although  they  had  many  hours  of  experience  in  the  low-level 
environment.  Both  these  points  raise  questions  about  the 
validity  of  using  the  distributions  to  predict  pilot  work¬ 
load.  To  dampen  this  argument  one  point  must  be  mentioned-- 
the  distributions  that  were  developed  were  the  combined 
distributions  of  stick  movement  that  were  used  by  three 
pilots  to  safely  fly  the  simulator  at  the  specified  alti¬ 
tudes.  Therefore,  it  can  be  said  that  in  using  the  distribu¬ 
tions  as  indicators  of  workload  in  the  wav  this  thesis  uses 
them',  predictior  if  pilot  workloads  can  be  made  for  the 
'!  r:!u«d  environment.  Further  study  is  required  using 

i  methods  of  measuring  controls  stick  movements. 

.•  ,  m  part,  measured  by  movement  of 
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AVERAGE  PILOT  STATISTICS 


1000  FEET 

Stick 

Movements 

No  Stick 

Movements 

Mean 

Std  Dev 

Mean 

Std  Dev 

1.509  sec 

1.414  sec 

1.631  sec 

1.692  sec 

500  FEET 

Stick 

Movements 

No  Stick 

Movements 

Mean 

Std  Dev 

Mean 

Std  Dev 

1.612  sec 

1.629  sec 

1.746  sec 

1.716  sec 

250  FEET 

Stick 

Movements 

No  Stick 

Movements 

Mean 

Std  Dev 

Mean 

Std  Dev 

1.426  sec 

1.289  sec 

1.514  sec 

1.490  sec 

STICK  MOVEMENTS 


TIME  IN  SECONDS 


NO  STICK  MOVEMENTS 


TIME  IN  SECONDS 


COMBINED  DISTRIBUTIONS,  1000  FEET 


Fig.  18.  Combined  Distributions  for  Pilots  at  1000  Feet 
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Fig. 


STICK  MOVEMENTS 


TIME  IN  SECONDS 


NO  STICK  MOVEMENTS 


COMBINED  DISTRIBUTIONS,  SOO  FEET 


19.  Combined  Distributions  for  Pilots  at  500  Feet 
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STICK  MOVEMENTS 


TIME  IN  SECONDS 


NO  STICK  MOVEMENTS 


TIME  IN  SECONDS 
COMBINED  DISTRIBUTIONS,  2S0  FEET 


Fig.  20.  Combined  Distribution  for  Pilots  at  250  Feet 


flight  controls.  Not  only  the  frequency  but  the  amount  of 
actual  stick  travel  in  each  movement  must  be  studied. 

After  the  stick  movement  and  non-movement  dis¬ 
tributions  were  developed,  data  was  gathered  via  the  SLAM 
program  for  the  analysis  of  pilot  workload. 


V.  Data  Collection 


Presented  in  this  chapter  are  the  measure  of  merit 
and  experimental  design  used  in  this  study.  Model  modifica¬ 
tion  for  different  profiles,  replication  requirement  deter¬ 
mination  and  the  employed  variance  reduction  technique  are 
also  discussed. 

Measure  of  Merit 

A  measure  of  merit  is  a  yardstick  for  measuring 
experimental  results.  In  the  case  of  simulation  experi¬ 
ments,  this  measure  is  often  specifically  designed  for  that 
study.  The  measure  of  merit  for  this  study  was  based  on  an 
adjustment  of  the  number  of  seconds  the  pilot  was  busy 
servicing  tasks  in  an  1800  second  mission.  The  adjustment 
was  accomplished  by  computing  the  difference  between  the 
number  of  seconds  the  pilot  was  busy  and  the  number  of 
required  service  seconds.  This  difference  was  then  doubled 
and  added  to  the  service  time  accomplished. 

Mom  =  S  +  2  (R-S ) 

Mom  =  Measure  of  merit 
S  =  Serviced 
R  =  Required 

The  difference  between  required  task  time  and  accomplished 
task  time  was  doubled  to  emphasize  the  failure  of  all  tasks 
to  be  completed.  Simply  measuring  the  required  task  time 
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for  each  profile  would  not  indicate  the  existence  of  high 
workload  density  in  portions  of  the  system.  This  concept 
was  based  on  the  idea  that  a  more  evenly  distributed  work¬ 
load  that  allows  completion  of  all  tasks  is  preferable  to 
a  system  with  overtasked  periods  that  prevent  completion  of 
every  task. 

Experimental  Design 

An  experimental  design  is  a  plan  for  the  orderly 
collection  of  data  to  be  analyzed.  The  design  consists  of 
the  selection  of  the  experiment  factors  (variables)  and  the 
different  values  the  factors  are  allowed  to  assume.  A  full 
factorial  experiment  is  one  that  collects  data  on  all  com¬ 
binations  of  factors  and  factor  levels.  The  experiment 
design  used  for  this  study  was  a  full  factorial  design  with 
two  factors  at  three  levels.  The  design  was  based  on  pro¬ 
viding  data  to  allow  an  analysis  of  variance  procedure  on 
proposed  mission  profiles  and  service  variation.  This 
design  required  nine  cells  of  data  with  sufficient  replica¬ 
tions  in  each  cell  to  provide  the  desired  accuracy  of  the 
sample  mean  of  each  cell.  The  nine  cells  represented  all 
the  possible  configurations  of  the  two  factors  with  three 
different  levels  of  each  factor.  The  full  factorial  design 
is  depicted  in  Figure  21. 

Model  Modification 

Data  collection  required  model  parameter  modifica¬ 
tion  to  simulate  the  nine  profiles  compared  in  this  study. 
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Fig.  21.  Full  Factorial  Experimental  Design 
ECM  Task  Levels 

0  -  No  action  required  by  the  pilot. 

1  -  Only  required  action  was  to  note  threat  presence 

no  equipment  manipulation  required. 

2  -  No  ECM  equipment  automation — full  service  as  speci 

fied  in  Chapter  III. 

Altitude  Level  (Feet  AGL) 

1  -  250 

2  -  500 

3  -  1000 


The  parameter  adjustments  for  each  of  the  three  altitudes 
selected  involved  changing  the  discrete  empirical  aircraft 
control  distribution  developed  for  each  altitude.  The 
required  modification  for  the  ECM  changes  involved 
changing  both  task  initiation  parameters  and  service  param¬ 
eters.  The  ECM  task  initiation  parameters  changed  with 
each  altitude  as  described  in  Chapter  III.  The  ECM  service 
parameters  were  altered  for  each  of  the  three  levels  of 
service  described  in  Chapter  III  by  setting  the  service 
time  equal  to  either  zero,  reduced  time  allowed  by  a 
fictitious  automated  threat  reaction  system  that  required 
RWR  scope  interpretation  only,  or  the  full  service  time 
required  for  manual  threat  interpretation  and  reaction. 

Experiment  Replications 

The  number  of  replications  for  each  cell  of  the 
experimental  design  was  determined  by  running  a  pilot  experi¬ 
ment  of  ten  replications.  The  results  of  this  pilot  run 
were  used  to  approximate  the  required  number  of  replications 
as  shown  in  Shannon  (Ref  10:186). 


where, 

n  =  number  of  necessary  replications; 

t  =  tabulated  t  value  for  the  desired  confidence 
level  and  degrees  of  freedom  of  the  initial 
sample ; 
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s  =  the  estimate  of  the  variance  obtained  in  the 
pilot  run;  and 

d  =  the  half-width  of  the  desired  confidence 
interval . 

2  2 

On  the  pilot  run  with  five  replications,  s  =  (43.47)  , 
t  =  2.23  and  d  was  selected  to  be  30  seconds.  The  result¬ 
ing  required  replications  were: 


n  =  (2.23! 2(43  472)  .  1033 
(30)  * 


Therefore,  eleven  replications  per  cell  were  planned  to 
achieve  the  desired  accuracy. 


Variance  Reduction 

In  order  to  increase  the  efficiency  of  the  model, 
a  variance  reduction  technique  was  employed  to  reduce  the 
number  of  model  runs  required  to  achieve  the  desired  out¬ 
put  accuracy.  The  pilot  sample  as  well  as  all  experiment 
replication  were  obtained  using  the  antithetic  variance 
reduction  technique.  In  the  SLAM  language  this  was 
accomplished  by  using  a  positive  seed  in  the  random  number 
generator  for  half  the  experiment  replications  and  using 
the  negative  of  the  same  seed  for  the  remaining  replica¬ 
tions  in  each  cell.  When  this  variance  reduction  technique 
is  used,  the  raw  data  must  be  transformed  into  a  new  sta¬ 
tistic  by  using  the  following  equation  (Ref  8:385). 
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whe  re , 


U.  =  the  new  test  statistic; 

1 

x^+  =  the  value  determined  using  a  positive  seed;  and 
x^_  =  the  value  determined  using  a  negative  seed. 

The  resulting  sample  size  used  in  the  analysis  of 
variance  (ANOVA)  procedure  is  smaller  but  the  variance  is 
significantly  reduced.  For  example,  after  the  model  was 
run  for  22  replications  (11  with  a  positive  seed  and  11 

2 

with  a  negative  seed),  the  raw  data  variance  was  (61.74) 

2 

and  the  variance  of  the  transformed  data  was  (28.41)  . 

After  having  run  198  replications  of  the  model  to 
obtain  99  data  points  (11  for  each  cell) ,  the  data  collec¬ 
tion  was  complete  and  data  analysis  began.  The  results 
of  the  data  collection  process  are  shown  in  Figure  22. 
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Fig.  22.  Data  Collection  Results 
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VI .  Data  Analysis 

In  order  to  demonstrate  the  usefulness  of  the  model 
in  studying  pilot  workload,  the  data  gathered  in  Chapter  V 
was  grouped  into  nine  cells  of  eleven  data  points.  The 
mean  (shown  in  Figure  22)  and  the  variance  of  the  measure 
of  merit  for  each  cell  was  compared  in  the  data  analysis 
process.  This  comparison  allowed  the  grouping  of  cells 
that  were  statistically  the  same  on  a  95  percent  confidence 
level,  a  =  .05.  The  analysis  also  identified  statistically 
differing  cells. 

Data  analysis  was  accomplished  in  two  phases.  The 
first  phase  was  the  use  of  a  two-way  ANOVA  procedure  using 
the  Statistical  Package  for  Social  Sciences  (SPSS)  (Ref 
6:399)  to  study  the  effects  of  the  main  factors  and  any 
possible  interactions  between  the  factors.  The  SPSS  output 
is  listed  in  Appendix  I.  The  second  phase  was  a  one-way 
ANOVA  procedure  using  SPSS  to  compare  the  means  of  each  of 
the  nine  profiles.  Each  profile  was  considered  a  treatment 
and  a  Duncan  Multiple  Range  Test  was  used  to  rank  the  means 
of  the  measure  of  merit  of  each  profile.  This  SPSS  output 
is  also  listed  in  Appendix  I. 

Two-Way  ANOVA 

The  two-way  analysis  of  variance  procedure  was  used 
to  investigate  the  effects  of  each  main  factor  (altitude 
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A  SIMULATION  TO  ANALTZE  PILOT  WORKLOAD  IN  AN  ELECTRO-OPTICAL »  N— ETC(U) 
MAR  81  A  N  GROVES»  R  L  KAERCHER 

UNCLASSIFIED  AFIT/GST/QS/BlM-5 _ NL 


CELL  MEAN  CELL  MEAN 

1000.01100.0  1200.0  1SOO.O  1400.0  1000.01100.0  1200.0  1300.0  1400.0 


MR IN  EFFECTS 


>i.o  o.o  i.o  a.o  3.0 

ECM 


MR IN  EFFECTS 


0.0  2SO.O  500.0  750.0  10C3.0  1250. 


ALTITUDE 


Fig.  23.  Main  Effects  Graph 
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and  ECM  service  time)  and  the  interaction  effect  of  the 


two  factors.  Based  on  a  95  percent  confidence  level,  only 
the  effect  due  to  altitude  change  was  statistically  sig¬ 
nificant.  The  analysis  of  variance  table  in  Appendix  I 
shows  the  degree  of  significance  of  each  effect. 

The  main  effects  as  a  group  were  significant. 

This  was  a  result  of  the  strength  of  the  altitude  change 
effect  and  the  near  significance  of  the  ECM  service  time 
effect.  The  ECM  service  time  would  have  been  significant 
at  a  92  percent  confidence  level.  Figure  23  shows  the 
trend  of  workload  with  each  main  effect.  This  figure  shows 
a  slight  increase  in  pilot  workload  (ordinate)  as  ECM  ser¬ 
vice  time  (abscissa)  is  increased.  This  was  anticipated 
and  seemed  intuitively  obvious.  Figure  23  also  shows  an 
increase  in  workload  as  altitude  was  increased.  This  was 
not  anticipated  when  this  thesis  was  undertaken,  but  after 
the  results  of  the  investigation  of  flight  control  param¬ 
eters  were  examined,  it  too  could  be  understood.  The  under¬ 
lying  cause  of  this  increase  was  due  to  the  increase  in 
defensive  reaction  rquirements  at  higher  altitude.  The 
more  significant  increase  from  500  feet  to  1000  feet  was  a 
result  of  the  defensive  maneuver  requirements. 

The  interaction  effect  of  the  change  of  both  fac¬ 
tors  simultaneously  was  very  insignificant.  This  was  indi¬ 
cated  in  the  ANOVA  table  (Appendix  J)  and  confirmed  by  the 
parallel  trends  of  the  lines  in  Figure  24.  This  result  was 
reasonable  because  the  magnitude  of  the  increase  due  to  the 
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effect  of  altitude  change  overshadowed  the  relatively 
minor  changes  in  ECM  service  requirements.  The  results 
of  the  defensive  reaction  task  investigation  (Appendix  D) 
indicated  that  the  number  of  ECM  task  requirements  roughly 
doubled  between  250  and  500  feet  but  the  increase  was 
largely  in  low  service  tasks.  The  change  from  500  to  1000 
feet  increased  defensive  reaction  requirements  by  only 
50  percent  but  the  bulk  of  the  tasks  shifted  to  higher 
service  time  tasks.  Defensive  maneuver  tasks  increased 
from  .5  percent  of  all  defensive  maneuvers  to  13  percent 
when  the  altitude  was  raised  from  500  to  1000  feet. 

In  summary,  the  two-way  ANOVA  indicated  that  the 
only  significant  effect  at  a  95  percent  confidence  level 
was  the  effect  due  to  altitude  change.  This  effect  was  a 
result  of  the  increase  in  defensive  reaction  requirements 
and  the  shift  to  tasks  that  required  longer  service  times. 
The  increased  number  of  defensive  maneuver  requirements 
at  1000  feet  had  a  significant  impact  on  the  workload. 

One-Way  ANOVA 

The  one-way  ANOVA  procedure  and  the  Duncan  Range 
test  were  used  to  compare  the  nine  conf igurationr  modeled. 
The  configurations  that  were  not  statistically  different 
were  grouped  and  the  groups  were  ranked  with  the  lowest 
measure  of  merit  ranked  first.  The  ANOVA  portion  of  the 
procedure  was  used  to  test  the  hypothesis  that  all  nine 
configurations  (treatments)  were  the  same.  The  ANOVA 
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indicated  that  there  was  a  significant  difference  between 
some  of  the  configurations.  The  one-way  analysis  of  vari¬ 
ance  table  in  Appendix  I  does  not  indicate  which  of  the 
treatments  differ  but  it  does  indicate  rejection  of  the 
hypothesis  that  all  nine  are  equal. 

In  order  to  determine  which  configurations  differed 
significantly,  a  multiple  range  test  was  used  to  group  the 
configurations  based  on  a  95  percent  confidence  level. 

The  Duncan  Range  test  contained  in  the  SPSS  package  was 
used  to  group  and  rank  the  configurations.  The  results  were 
that  all  configurations  at  250  and  500  feet  were  sta¬ 
tistically  the  same  and  formed  the  first  group.  The  second 
group  included  all  configurations  at  1000  feet.  The  means 
of  the  measures  of  merit  for  the  first  group  ranged  from 
1185.4  seconds  to  1218.3  seconds,  a  change  of  only  2.7 
percent.  The  second  group  ranged  from  1292.5  to  1324.5 
seconds,  a  change  of  2.4  percent.  The  difference  between 
the  group  means  was  109.6  seconds,  a  change  of  8.7  percent. 
The  total  change  between  the  lowest  mean  of  1185.4  seconds 
and  the  highest  of  1324.5  seconds  was  139.1  seconds. 

Based  on  the  grand  mean  of  all  the  configurations,  this 
was  a  change  of  11.2  percent. 

In  summary,  the  one-way  ANOVA  indicated  that 
changing  the  altitude  profile  from  500  to  250  feet  did  not 
cause  a  statistically  significant  change  in  workload  regard¬ 
less  of  the  ECM  service  requirements.  A  change  from  1000 
feet  to  250  or  500  feet  did  cause  a  statistically 


significant  change  in  workload.  The  results  of  this  pro¬ 
cedure  agreed  with  the  results  of  the  two-way  procedure 
by  indicating  that  ECM  service  requirements  did  not  sig¬ 
nificantly  change  workload. 

ANOVA  Validity 

The  assumptions  associated  with  the  ANOVA  pro¬ 
cedure  (Ref  14:86)  were  tested  and  all  assumptions  were 
satisfied.  The  independence  assumption  was  tested  using  a 
Runs  Test  to  support  the  concept  that  the  data  points  were 
independent  based  on  the  use  of  pseudo  random  number 
generators  in  the  SLAM  procedures.  The  constant  variance 
assumption  was  confirmed  using  the  Bartlett  Box  Test.  The 
normality  assumption  was  tested  by  computing  the  residuals 
and  confirming  that  at  least  95  percent  were  inside  two 
sample  standard  deviations.  The  tested  hypothesis  and 
results  for  each  test  are  contained  in  Appendix  J.  These 
tests  establish  the  validity  of  the  use  of  an  ANOVA  pro¬ 
cedure  for  data  comparison. 

Results 

The  two  phases  of  the  data  analysis  indicated  that 
pilot  workload  was  not  the  same  for  the  nine  workload  situa 
tions  modeled.  The  results  are  listed  below. 

1.  ECM  service  level  changes  had  no  statistically 
significant  impact  on  pilot  workload  at  any  of  the  three 
altitudes  modeled. 
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2.  Pilot  workload  significantly  decreased  (8.7  per¬ 
cent)  when  the  aircraft  altitude  was  lowered  from  1000 

to  500  feet  AGL.  This  resulted  from  the  decreased  exposure 
to  enemy  threat  systems.  The  number  of  threats  decreased 
by  32  percent  but  the  requirement  to  perform  defensive 
maneuvers  decreased  from  13  percent  of  all  required  ECM 
tasks  to  .5  percent.  This  large  decrease  in  the  number  of 
long  service  time  tasks  caused  the  significant  difference 
between  1000  and  500  feet  AGL. 

3.  There  was  no  significant  difference  in  work¬ 
load  at  500  and  250  feet  AGL. 

These  results  indicate  that  workload  can  be  ana¬ 
lyzed  by  using  a  man-machine  model.  The  conclusions  that 
can  be  drawn  from  this  study  are  presented  in  Chapter  VII. 


VII.  Conclusions  and  Recommendations 


This  research  addressed  the  problem  that  a  realis¬ 
tic,  objective,  and  relatively  inexpensive  method  for 
evaluating  the  impact  of  a  proposed  night  attack  system  on 
pilot  workload  was  not  available.  The  specific  area  studied 
was  the  comparison  of  pilot  workload  at  1000,  500  and  250 
feet  AGL  with  three  possible  levels  of  required  ECM  ser¬ 
vice.  After  the  mission  and  system  to  be  modeled  were 
defined,  a  network  model  was  constructed  using  the  SLAM 
simulation  language.  Parameters  for  flight  control  inputs 
to  the  model  were  developed  using  the  A-10  LANTIRN  simu¬ 
lator  located  at  the  Crew  Station  Design  Facility  at 
Wright-Patterson  AFB ,  Ohio.  After  parameter  refinement  and 
model  improvement  were  completed,  data  collection  was  under¬ 
taken  for  the  nine  cells  in  the  full  factorial  experiment. 
The  measure  of  merit  used  penalized  a  cell  when  the  pilot 
did  not  complete  all  of  the  required  tasks.  Data  analysis 
revealed  that  ECM  service  levels  were  not  a  significant 
factor  in  the  comparison  of  the  nine  workload  levels. 
Altitude  was  a  significant  factor  in  workload  changes. 

The  workload  at  250  and  500  feet  AGL  was  significantly 
lower  than  the  workload  at  1000  feet  AGL  because  the 
intensity  of  the  threat  of  enemy  defense  systems  was  sig¬ 
nificantly  reduced  at  the  lower  altitudes.  The  requirement 
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to  perform  defensive  maneuvers  at  500  feet  AGL  was  3  percent 
of  the  requirement  at  1000  feet  AGL.  The  workload  at  250 
and  500  feet  was  statistically  the  same. 

Conclusions 

The  conclusions  reached  as  a  result  of  this  study 
are  listed  below. 

1.  A  comparative  pilot  workload  analysis  can  he 
performed  using  man-machine  simulation. 

2.  If  the  primary  cue  for  terrain  following  and 
terrain  avoidance  is  the  terrain  following  director  cue 
on  the  HUD,  the  resulting  flight  control  input  distribu¬ 
tions  do  not  significantly  differ  at  altitudes  of  250,  500 
and  1000  feet  AGL. 

3.  A  threat  management  system  to  relieve  a  pilot 
of  ECM  tasks  will  not  significantly  reduce  workload  even 
if  the  system  completely  eliminates  these  tasks. 

4.  The  most  significant  defensive  reaction  task 
is  the  requirement  to  perform  defensive  maneuvers  to 
defeat  enemy  threat  systems.  This  requirement  is  signifi¬ 
cantly  reduced  when  the  aircraft  altitude  is  changed  from 
1000  to  500  feet  AGL.  The  main  tactic  that  can  be  used 

by  a  pilot  to  reduce  the  threat  and  thus  reduce  workload 
is  to  fly  at  his  lowest  comfort  altitude  below  1000  feet  AGL. 

Limitations 

The  major  limitations  of  this  study  were  the  use  of 
a  simulator  to  draw  data  from  which  flight  control  movement 
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distributions  could  be  developed  and  the  simulated  threat 
array  that  was  used  to  develop  the  threat  input  parameters. 
The  magnitude  of  the  limitation  of  the  flight  control  data 
could  be  evaluated  in  two  ways.  First,  the  distributions 
developed  for  this  thesis  could  be  compared  to  distribu¬ 
tions  of  required  flight  control  movements  developed  from 
equations  of  dynamic  stability  for  a  representative  air¬ 
craft  on  a  similar  profile.  The  data  developed  from  equa¬ 
tions  would  represent  the  minimum  number  of  movements 
required  to  fly  the  aircraft  over  the  specified  terrain. 

A  comparison  of  the  data  from  the  two  sources  could  be  made 
to  determine  the  similarity  of  the  two  groups  of  distribu¬ 
tions.  Second,  data  from  an  actual  aircraft  could  be 
gathered  on  a  low-level  mission  over  similar  terrain  with 
the  intent  of  comparing  the  data  from  the  two  environments. 

The  limitations  of  the  threat  array  are  the  assump¬ 
tions  made  by  Leek  and  Schmitt  for  their  model.  The  data 
they  used  was  from  unclassified  sources.  The  accuracy  of 
the  sources  was  uncertain  but  the  data  was  assumed  to  be 
representative  of  the  real  world.  To  delete  this  limita¬ 
tion  actual  data  would  have  to  be  used  which  would  require 
classification  of  this  thesis. 

Recommended  Areas  for  Further  Study 

This  model  was  developed  as  an  example  of  the 
utility  of  man-machine  simulation  in  pilot  workload  analysis 
With  this  in  mind,  the  next  logical  extension  of  this  model 
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would  be  to  include  the  weapon  employment  phase  in  the 
mission  profile.  This  would  allow  evaluation  of  workload 
on  varying  employment  concepts  and  offer  an  opportunity  to 
identify  workload  limitations  on  multiple  target  profiles. 

The  scope  of  the  model  could  also  be  expanded  to 
examine  the  effect  of  workload  on  the  probability  of  mis¬ 
sion  success.  This  would  require  more  attention  to  the 
time  allowed  between  task  input  and  task  completion  and 
establishing  realistic  parameters  for  the  effects  of  incom¬ 
plete  or  incorrect  task  accomplishment  on  the  mission 
probability  of  success. 

The  final  recommended  area  for  further  study  is 
the  use  of  the  continuous  feature  of  the  SLAM  language. 

Using  the  aircraft  equations  of  state  would  identify  the 
minimum  number  of  flight  control  inputs  required  to  maintain 
aircraft  control  and  indicate  a  lower  boundary  on  the  flight 
control  movements  for  different  mission  profiles. 
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Model  Network  Diagram/Flow  Charts 


This  appendix  contains  the  model  network  diagrams 
and  the  flow  charts  for  the  subroutines.  Figure  A-l  is  an 
overview  diagram  of  the  network.  It  shows  the  large  divi¬ 
sions  of  the  model  that  are  shown  in  detail  in  later 
figures . 


Overall  Network  Schematic 


Figure  A-2.  Flight  Control  Task  Initiation 


**<?»  «■  m>. 


Defensive  Reaction  Task  Initiation 


Fig.  A-4 .  Systems  Operation/Monitoring  Task  Initiation 


Fig.  A-5 .  Navigation  Task  Initiation 


Critical  Task  Queue  and  Service 


Fig.  A-7.  Regular  Task  Queue  and  Service 


DIMENSION. . . 
COWDN 
EQUILALENCE 
NNSET  =  5000 
NCRDR  =  5 
NPRNTR=  6 
MTAPE  =  7 


CALL  SLAM 


Fig.  A-9 .  Programs  MAIN  and  OTPUT 
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Fig.  A-ll.  EVENT  2 
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Fig.  A-13 .  EVENTS  4  and  5 


Fig.  A-15.  USERF  2 


Fig.  A-16 .  USERF  3  and  4 


Model  Code  List in 


This  appendix  contains  the  model  computer  code 
listing.  Description  and  documentation  is  contained  in 
the  listing. 


All, CM1330D0»T140, 10100.  T790541  »GROVES, 4421 . 

ATTACH, SLAM,  ID'-AFIT. 

FTN,SYSEDIT. 

ATTACH ,  TAPE8 , RE8U IRE , CY = 1 . 

ATTACH » TAPE9 , DATA , C Y = 1 . 

SKIPF, TAPES, 1, 17, B. 

SKIFF, TAPE9.lt 17, B. 

COPYL,$LAH,LGC»RUN»,RA. 

RUN »PL: 20000. 

EXTEND, TAPE8. 

EXTEND , TAPES. 

REMIND, TAPES. 

REWIND, TAPES. 

RETURN. TAPES. 

RETURN, TAPES. 

C 

PROCRAH  MAIN  UNPUT  .OUTPUT ,  TAPES'- INPUT ,  TAPES  OUTPUT 
*,TAPE7, TAPES, TAPES) 

DIMENSION  NSET (5020) 

COMMON /SCOH 1 / ATR I B < S  00 ) , DD ( 1 00 ) , DDL ( 1 0  0 i , DTNOH , 1 1 , MFA , MSTOP , 
iNCLNR .NCRDR iNFfiNT, NNRUN , NNSET .NTAPE, SS ( 100 ) , SSL (1 00 I , 
*TNEXT,TNOH,XX(100) 

COMMON  QSEK5000) 

EQUIVALENCE  INSETU) ,QSETU)> 

NNSET=S000 
NCRDR-5 
NPRNT=6 
NT APE-7 
CALL  SLAM 
STOP 
END 
C 

C  ilHHiHIHHHiHiHIHiHHHHHtlHIHi 

C  «  GLOSSARY  OF  GLOBAL  VARIABLES  « 

C  *  XX (11-SWITCH  TO  IDENTIFY  THE  FIRST  NAV  LEC  I 

C  *  XX(Z)  THRU  XX(13)-SHITCHES  TO  IDENTIFY  AN  UNCOMPLETED  « 

C  §  TASK  IN  THE  QUEUE,  THE  !#)  CORRESPONDS  TO  THE  « 

C  *  FIRST  ATTRIBUTE  VALUE  OF  THE  TASK  * 

C  *  XX <191 -SWITCH  TO  IDENTIFY  AN  UNCOMPLETED  TASK  IS  * 

C  *  XXI2U-SUITCH  TO  INDICATE  THE  SUCCESS/FAILURE  OF  A  » 

C  *  NAV  POINT  SEARCH  ♦ 

C  *  XXIZZ)-SHITCH  TO  IDENTIFY  AH  INCOMPLETE  NAV  TASK  IN  « 

C  «  THE  QUEUE  t 

C  «  XX <23) -SWITCH  TO  ALlOU/STCP  NAV  POINT  SEARCHES  ♦ 

C  *  XX (32)  THRU  XX(3S»-  SAME  AS  XX(Z0i  THRU  IX(S0l  EXCEPT  * 

C  «  THESE  MERE  FOR  TASKS  COMPLETED  * 

C  «  XX(f)  TASK  0  COMPLETED/REQUIRED 
C  •  20, 30, 40, 50  2,3,4, 5  REQUIRED  * 

C  •  40-70,80,90  4,7,8, S  REQUIRED  * 

C  «  32  THRU  3S  Z  THRU  S  COMPLETED  * 

C  «  41  THRU  44  11  THRU  14  COMPLETED  ♦ 

C  •  45  THRU  48  1S,??,3«,4«  r.OKPI  PTFH  « 
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14,15.16,18  74,75  76,81 
91  THRU  94  11  THRU  14 


COMPLETED 
REQUIRED 
REQUIRED 

82,83,84,85  22, 38, 44, 74, 7S  REQUIRED 

86,87,89  75,76,81  REQUIRED 

98  TOTAL  COMPLETED 

-  99  TOTAL  REQUIRED 

■  II <55! -SWITCH  TO  ALLOW  AH  OPS  CHECK  TASK 

■  II <71! -PARAMETER  fOR  DEFEHSIVE  REACTION  INPUT 

•  II (73) -PARAMETER  FOR  RATIO  OF  DEF  MANEUVERS  REQUIRED 

-  TO  DEF  REACTIONS  INITIATED 
II(74)-RAN00M  NUMEER  TO  TEST  PROPER  TASK  ACCOMPLISH¬ 
MENT,  I.  E.  STRESS  TEST 

i  XI (75) -DEFENSIVE  MANEUVER  STRESS  SWITCH 
i  IK761-ECM  STRESS  FACTOR  PARAMETER 
i  II(78)-DUMMT  PARAMETER  TO  REMOVE  NORMAL  ERROR  RATE 
WHEN  TESTING  FLIGHT  CONTROL  TASKS  FOR  PROPER 
i  COMLETEION 

IH791-NAV  LEG  COUNTER 

■  XI (96) -RANDOM  NUMBER  FOR  STRESS  TEST  OF  FLIGHT  CONTROL 
TASKS 

.  XI (971-TOTAL  STRESS  VARIABLE 
II) 98) -COMPLETED  SERVICE  TIME 
i  XI (99) -REQUIRED  SERVICE  TIME 

IIHHIMHHHIHHillHHHiHHHHHHHmiHHIHi 

iHHKHHlHIHHIIMHIHHiHIIHHHHHHHIKiH 


C  »  EVENT  SUBROUTINES  FOR  STRESS  ,  NAVIGATION  SUCCESS  ,  « 

C  »  ELIMINATION  OF  EXTRA  FLIGHT  CONTROL  INPUTS  l  « 

C  »  COLLECTING  DATA  ON  TASK  TIMES  « 

C 

SUBROUTINE  EVENT  (I) 

COMHON/SCOM1/  ATRIB<100)»DD(100),DDL(100)>DTNOH,II,MFA,MSTOP> 
«NCLNR,t:CRDR ,  NPRNT ,  NNRUN ,  NNSET ,  NTAPE ,  SS  ( 102 1  >  SSL  ( 100  >  > 
*TNEXT»TNOW»XX(100) 

T"'**cNSION  A(7) 

C 

C  »  IN1TILIZE  STRESS  FACTOR  TERMS  « 

DATA  STRECR , STRN AV , STRM AN , TOTSTR  /4*l./ 

CO  TO  (1,2, 3, 4, 5), I 


C  »  COMPUTE  STRESS  IMPACTS  OH  SERVICE  TIMES  « 

C 

C  »  ECM  STRESS  =  CURRENT  2  MIN.  MEMORT  OF  ECM  SERVICE 

C  TIMES/1844  « 

1  STRECM=H<76>/1000. 

C  »  IF  THE  DEFENSIVE  MANEUVER  SWITCH  IS  SET  INCREASE 
C  THE  STRESS  FACTOR  BT  .03  « 

1F(XX(75).CE.1.)  STRMAN=  .83 
C  »  IF  THE  LAST  NAV  POINT  WAS  NOT  SEEN  INCREASE  THE 
C  STRESS  FACTOR  BT  .03  « 

IF ( XX (2 1 ) .EQ. 0 . )  STRNAV=  .03 
C  »  SUM  THE  STRESS  FACTORS  « 


'  lKWhSTRECH  4  STRMAN  4  STRNAV 

RETURN 

C 

C  »  DETERMINE  IF  THE  NAV  POINT  HAS  SEEN  « 

C 

2  SEEIT  =  BRAND (7) 

C  »  THERE  IS  A  101  CHANCE  THAT  THE  NAV  POINT  HILL 
C  NOT  BE  SEEN— SET  THE  SWITCH  TO  0.  IF  NOT  SEEN  « 

IF  <SEEIT.CE . . 90>  11(211=0. 

"  IF(SE£IT.LT..901  11(211=1. 

RETURN 

C 

C  »  REMOVE  CONTROL  INPUTS  THAT  HERE  GENERATED  UK HE  « 
C  »  TASKS  40  OR  75  HERE  BEING  SERVICED  BECAUSE  THESE  « 
C  »  TASKS  HOULD  EE  DONE  AS  PART  OF  TASKS  40  i  75  « 

3  HO  301  J--1.5# 

HKSPOT=0 

NKSPOT  =  NFIND(li2)ii0i30.i0.1 
IF (HKSPOT . EQ . 01  GO  TO  302 
CALL  RNOVE 1 HKSPOT » 2 » A 1 
n<991=nW)-A(2) 

IX(83)=X]«83)-A(2) 

301  CONTINUE 

302  RETURN 
C 

C  »  EVENTS  4  Si  5  ARE  USED  TO  COLLECT  TASK  TIME  « 

C  »  DATA  FOR  ANALYSIS— EVENT  4  COLLECTS  DATA  ON  « 

C  »  COMPLE1ED  TASKS  HHILE  EVENT  5  COLLECTS  DATA  « 

C  »  ON  TASKS  THAT  HERE  T0  BE  ACCOMPLISHED  « 

C  »  TOTAL  TASKS  COMPLETED  « 

4  IF(ATRIE(2).LT.0.1  RETURN 
lF(ATRIBd).EQ,Z.)  n(32)=U<32)  ♦  ATRIB(2» 

IF ( ATR I B ( 1 1 . EQ . 3. 1  11(331=11(331  +  ATRIB(Z) 
IF(ATRIB(1).EQ.4.1  11(341=11(34)  4  ATRID(Z) 
IF(ATRIB(1).EQ.5.)  XX (35) =XX (35)  4  ATRIB(Z) 
IF(ATRIB(1).EQ.4.)  11(361=1(1(34)  ♦  ATRIB12) 

IF (ATRIBd). EQ. 7.)  11(371=11(371  4  ATRIB<2) 

IF (ATRIBd  1  .EQ.8. 1  11(381=11(30)  4  ATR!3(2I 
IF(ATRIB(1).EQ.9.1  11(391=11(39)  +  ATRIBI2) 

IF  (ATRIBd  1  .EQ.  1 1 . 1  XX  <41 1  =XX  (41 1  4  ATRIBI2I 
1FIATR1B(1).EQ.12.)  IX 1*2) =XX 1*2)  ♦  ATR1BI2) 

IF  (ATRIBd)  .EQ.  13. 1  XX  (43) =XX  (*3I  ♦  ATRIB(2) 

IF  (ATRIBd)  .EQ.14.)  IX(44)=nM41  ♦  ATRIB42) 

IF  (ATRIBd )  .EQ.  19. 1  II(45I*H<«)  ♦  ATRIBI2) 
IF(ATRIBd) .Efl.22.1  IX(4o)=XlM&)  ♦  ATRIB(Z) 

IF  (ATRIBd  l.EO. 33.)  XX  ( *7)  =XX  (47 1  4  ATR1BI2) 

IF (ATRIBd  I, Efi. 40. 1  X  X  <  48)  =  XX  (46)  4  ATR  IB  (2) 

IF  (ATRIBd  1  .E0.74. 1  XX  ( 1 4)  =XX<  14)  4  ATR  IB  ( 2 1 
IF  (ATRIBd  1  .EQ.75. )  XX(15i=XX(15)  4  ATRIBd) 

IF (ATRIBd). EO. 76.)  11(161=0(16)  4  ATRIB <21 
!F(ATRIBd).EQ.81.1  11(181=11(18)  4  ATRI8I2) 

11(98)  =  11(98)  4  ATRIB (2) 

RETURN 

C 
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C  »  TOTAL  TASKS  REQUIRED  « 

5  JF(ATRIB(2).LT.0.)  RETURN 

IF (ATRI8 ( 1 > .EQ . Z . )  11(201=11(28!  ♦  ATRIBI2) 
lF(ATRIBU) .EQ.3.)  XI (30)  =XX (33)  ♦  ATRIB(Z) 

IF (ATR IB ( 1 ) . EQ . 4 . >  11(401=11(40)  4  ATRIBI2) 

IF (ATRI B ( 1 ) . EQ . 5 . )  XX (50) =XX (53)  +  ATR I B ( 2 ) 

IF(ATRlBd) .EQ.6.)  XI(4#i=mt3)  4  ATRIB(2I 
IF(ATRIB(1).EQ.7.)  11(701=11(701  4  ATR I B ( 2 1 
IF (ATRIB ( 1 ) .EQ.6. )  XX (80)  =XX (6(0)  +  ATRIB(Z) 

IF (ATRIB ( 1 )  .EQ . 9 . )  XX (90) =XX (90)  4  ATRIB(2I 
IF(ATRIB(l).EQ.ll.)  XX <91 ) =XX (91 )  4  ATR!B(2) 

!F (ATRI8(1 ) .EQ. 12. )  XX (92) =XX (92)  4  ATRIB (2) 

IF (ATRIB ( 1 ) . EQ . 13. )  11(931=11(93)  4  ATRIB (2 ) 

IF(ATRIB(1) .EQ.14.)  XX (94) =XX (94)  4  ATRIBI2) 

IF (ATRIB ( 1 ) .EQ.19.)  XX (95) =XX (951  4  ATRIB (2) 

IF (ATRIB ( 1 ) .EQ. 22 . >  XX (62) =XX (82)  +  ATRIB12) 

IF(ATRIBU) .EQ.30.)  XX (83)=XX (83)  ♦  ATRIB  12) 

IF(ATRIB(1) .EQ.40.)  11(841=11(84)  4  ATR IB ( 2 ) 

IF(ATRIBd)  .EQ.74.)  11  (65)=X1  (85)  4  ATRIB (2) 

IF(ATRIBd) .EQ.75.)  XX (84>)  =XX (86)  4  ATRIB(2I 
IF(ATRIBd)  .EQ.76.)  XI (67) =1X (87)  4  ATRIBI2) 

IF(ATRIBd) .EQ.81 .)  IX (89) =1X (89)  4  ATRIB (2) 

11(99)  =  11(99)  4  ATRIB(Z) 

RETURN 

END 

C 

C. 

SUBROUTINE  OTPUT 

COHHON/SCON1 /  ATR I B ( 1 00 ) . DD ( 1 00 1 , DDL  < 1 00 ) » DTNOU , 1 1 » UFA . MSTOP , 
<NCLNR i NCRDR » NPRNT i NNRUN i NNSET  >  NT APE»  SS( 100 1 1 SSL ( 100 1 » 
iTNEXT.TNON. 11(100) 

C 

C  »  NECH  =  ECH  LEVEL 
C  »  NALT  =  ALTITUDE 

C  . 

C . 

NECH=2 

NALT=3 

C . . . 

C  . . . 

c 

WRITE (6» 1001 )  ( XX ( I ) 1 1 =23 1 90 » 10) 

WRITE (6t 1002)  (XX(I) i I=91>95)» (XI (I) >I=82t89t r 11(99) 

C 

WRITE <&t200 1 )  (XX(I) >I=32r39) 

WRITE (6»2002)  (XX(I) (1=41(48) 

WRITE <(> ( 2003)  (1X(I) (1  =  14(16) dX(98) 

WRITE (8(3001)  (XKI) (I=2C(90(10)t (IK I) i I=9t (95) ( 
«IIX(I)»I=82(89)(IK99) 

WRITE(8(300D  (IK »)( 1=32(391  ( (IKI)  i  I=4ti48) 
<i(II(I))I=!4il8)(XK98) 

WRITE(9»4001)  NECfl *KALT •  XI(  73)  tXX(99) 

4011  FORNATdl(  12(11(12(1 1  (riB.3 1 11  (F10.3I 
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c 

1001  FORMAT (11. "TASK  TIKES  TO  fCCQKPLISH'7/"  T2  =  ",F8.3, 

•"  T3  -  "»F8.3*“  T4  =  ".FS.3."  T5  =  ".F8.3i"  T6  =  ".F8.3 

T7  -  "»F8.3."  T8  =  ".F8.3."  T9  =  ",F8.3I 

1002  FORKATUl,"  Til  -  ".FS.3.“  T12  =  “,F8.3,"  T13  =  ".Fe.3. 

*•  T14  *  “.F8.3"  T19  =  M.F8.3i"  T22  =  ",F8.3."  T3I  =  ".F8.3. 
•*  T4I  =  ".F8.3./1X."  T74  =  H.F8.3."  T75  =  ".F8.3» 

♦"  T76  *  H.F8.3»"  T77  =  ".F8.3."  T81  =  ".F8.3//11. 
i,"TOT  REQUIRED  =  “,F10.31 

2001  FORKATUl,//"  TASK  TIKES  ACCOKPLISHED  "//"  T2  =  ",F8.3, 

♦"  T3  =  “»F8.3,"  T4  =  ",F8.3,"  T5  =  ".F8.3,"  T6  =  ", 

»F8.3,"  T7  =  “,F8.3,"  T8=  ",F8.3,"  T9  =  ",F8.3I 
2M2  FORKATUl,"  Til  *  “,F8.3,"  T12  »  "^8.3,"  T13  «  ",F8.3, 

T14  =  ",F8.3,"  T19  *  ",F8.3,"  T22  =  ",F8.3,"  T38  «  ", 
♦F8.3»“  T40  *  “,F8.3) 

2103  FORKATUl,"  T74  =  ",F8.3,"  T75  =  “,F8.3,"  T76  =  ", 
iF8.3»“  T77  =  ",F8.3,"  T81  *  ",F8.3 // 
i*  TOTAL  TASK  TIKES  ACCOKPLISHED  *  ",F10.3I 
3001  FORKATUl, 7F8.3/7F8.3/7FB.3/F10. 3) 

RETURN 

END 

C 

C 

C  »  USER  FUNCTION  FOR  FLIGHT  PARAKETER  ,ECK,  OPS  CHECK  « 

C  »  REQUIREMENTS  « 

C 

FUNCTION  USERFUFN) 

COKKON/SCOK  1 /A  7RI8  U  00) , DD  U  00) , SSL  U  0f / , DTNOW » 1 1 >KFA, 
iNSTOP, NCLNR,NCRDR,NPRNT,NNRUN,NNSET,NTAPE,SS  (1001  »SSLU00I, 
•TNEXT.TNOU, 11(100) 

DIMENSION  PROBV (300) ,RNVEC(300) ,PROBD(300I ,RNVECB(300) 

DATA  TLASTCK , TLSTSND/ 2*0 . / 

C  »  THE  NE1T  2  DATA  STATEMENTS  DEFINE  THE  AIRCRAFT  CONTROL 
C  INPUTS:  RNVEC  *  SERVICE  TIKES 
C  PROBV  -  CUMULATIVE  PROBABILITY  OF  INPUT 

C  RNVECB  *  TIKE  UNTIL  NEIT  INPUT 

C  PROBB  *  CUMULATIVE  PROBABILITT  OF  TIKE  BETWEEN 

C 

DATA  RNVEC/. 3*. 4,. 5, .4,. 7*. 8,. 9,1. *1.1, 1.2, 1.3, 1.4 

1.1.5. 1.6. 1.7. 1.8. 1.9. 2..  2. 1.2. 2. 2. 3. 2. 4. 2. 5. 2. 6 
f,2. 7, 2. 8, 2. 9, 3., 3. 1,3. 2, 3. 3, 3. 4, 3. 5, 3. 6, 3. 8, 3. 9 
♦,4., 4. 2, 4. 4, 4. 5, 4. 6, 5. 2, 5. 3, 5. 4, 5. 9 ,6. 8, 6. 9, 7. 

1,7. 4, 7.4, 8. 3, 13.9/, PROBV/. 07 

•,. 166,. 229,. 288,. 345,. 404,. 456,. 487, .52,. 586,. 605,. 824 
t*. 662, .688,. 716,. 738,. 751,. 766,. 788, .81,. 823*. 836,. 849,. 856 

1. . 867.. 873. .88. .891. .902. .913. .917. .924. .926. .93. .939. .943 

1. . 95.. 956. .959.. 961. .967. .972. .978. .983. .985. .987. .989. .991 
•,.993, .996, .998,1./ 

DATA  RNVECB/. 3 

1.. 4. .5. .6. .7. .8. .9.1. .1.1. 1.2. 1.3. 1.4 

1.1.5. 1.6. 1.7. 1.8. 1.9. 2..  2. 1.2. 2. 2. 3. 2. 4. 2. 5. 2. 6 

1.2.7. 2.8. 2.9. 3..  3. 1.3. 2. 3. 3. 3. 4. 3. 5. 3. 6. 3. 8. 3. 9 
•,4. ,4.1, 4.2, 4. 3, 4. 4, 4. 5, 4. 6, 4.8, 4.9, 5. 3, 5. 6, 5. 9 

1.6..  6. 1.6. 2. 6. 4. 6. 5. 7. .7.2.7.3.7.4.8.7.10.7.11.2 


119 


r>  n  o  o  r> 


*>lt.9>12.3/)PROEB/.059 

*i.tl2).171>.243>.329>.425>.456>.511>.546> .58l> .683)  .63. 
♦).46).684).706>.724f .748>.761>.776>.796>.314).827>.636>.8<9 
»i. 855». 86). 868). 882). 888). 893). 897). 904). 988). 912). 917). 919 
*). 923). 93). 932.. 936). 943). 945). 947). 95). 952). 956). 958).  961 
*). 965). 967). 969). 971).  974).  98>. 985).  987). 989).  991). 993). 996 
«» .998)1./ 

C 

CO  TO  (1)2)3)41 )!FN 
C 

C  »  DETERMINE  THE  ELICHT  CONTROL  PARAMETERS  « 

C 

1  J=1 

2-0RAND43) 

C  »  IF  THE  GENERATED  RANDOM  NUMBER  IS  LESS  THAN  THE 
C  CUM.  PROB.  AT  THAT  STEP  TAKE  THE  ASSOCIATED  INPUT 
2#  JF(Z.L£.PR08V(J!)  CO  TO  10 

J-J+l 
CO  TO  20 

10  U$ERF=RNVEC(J1 

2Z-0RAN044) 

JJ=1 

C  »  IF  THE  GENERATED  RANDOM  NUMBER  IS  LESS  THAN  THE 
C  CUM)  PROB.  AT  THAT  STEP  TAKE  THE  ASSOCIATED  INPUT 
40  IF(ZZ.LE.PROEB(JJ!l  CO  TO  30 

CO  TO  40 

30  n(62)=RNVECB(JJ! 

RETURN 

»  USER  FUNCTION  FOR  THE  TYPE  AND  SERVICE  TIMES  ON  ECM  TASKS  « 
ECMREQ-0RAND<7) 

»  171  OF  THE  ECM  TASKS  REQUIRE  POD  CONTROL  SNITCH  CHANGES  « 

IF (ECNREQ . LE . . 1 7 )  USERF =RNORM ( 4 . 2 ) 1 . 05  >  7 1 
C  »  261  OF  THE  ECM  TASKS  REQUIRE  ALE-40  ACTIC.S  (FLARE  OR 
C  CHAFF  DISPENSING!  AND  NOTING  THE  SICI.H.  ON  RUR  SCOPE  « 
IF(ECMREQ.GT..17.AND,ECMREQ.LE..431USERF:RN0RM(l,7).6)7l 
C  »  571  OF  THE  ECM  TASKS  REQUIRE  ONLT  NOTING  THE  SIGNAL 
C  ON  THE  RHR  SCOPE  « 

IF<ECMREQ.GT..43)  USERF=RN0RM(.4).2)7> 

102  RETURN 
C 

C  »  WEN  LESS  THAN  2  TASKS  ARE  TO  EE  SERVICED  (ONE  OF  NHICH 
C  IS  IN  SERVICE)  DO  AN  "CPS  CHECK"  IF  ONE  HAS  NOT  BEEN 
•  C  DONE  IN  THE  LAST  5  MINUTES  « 

3  IF(NNQ(3).GT.1.)G0  TO  105 

C  »  DETERMINE  THE  TIME  SINCE  THE  LAST  “OPS  CHECK"  « 

C  TLASTCK  *  TIME  LAST  OFS  CHECK  COMPLETED 
C  TUSTSND  =  TIME  LAST  OPS  CHECK  SENT  TO  QUEUE 
SPAM*  THOU-TLASTCK 
WHEM=TNOM-TLSTSND 

C  »  TEST  TO  SEE  IF  "OPS  CHECK"  IS  REQUIRED  « 

!F(SP AN. GT. 300. AND. NHEN.GT. 380.1  GO  TO  103 
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C  »  IF  NO  "OPS  CHECK"  REQUIRED  SET  USERF=0.  « 

105  USERF =f . 

RETURN 

C 

C  »  SET  SNITCH  REQUIRING  THE  OPS  CHECK  « 

If 3  USERF- 1. 

TLST$NDsTNOH 

RETURN 

C 

C  »  USER  FUNCTION  TO  HARK  TINE  OF  LAST  “OPS  CHECK"  COKPLETTOM  « 

4  USERF-0. 

TLASTCK=TNON 

RETURN 

C 

END 

CEN i GROVES  tLOULVLt 01/14/81 »22> 

LIHITS>4»6> 140» 

i  «  NEGATIVE  SEEDS  FOR  ANTITHETIC  VARIANCE  » 

5  «  RANK  TASKS  BT  PRIORITY (ATRIBI3) )  -  HIGHEST  FIRST  » 

!  «  IF  TASKS  HAVE  SANE  ATRIBI3)  PUT  OLDEST  FIRST  » 

PRIORITYT/l,HVF(3)/2,HVF(3l/3iHVF(3I/NCLNR,LVF(JEVNT)« 

network; 

i  «  RESOURCE  FOR  SHORT  TERN  HEHORT-  MULTIPLE  SERVICE  SCHENE  » 

5  «  RESOURCE  FOR  PILOT-  SERVER  )) 

RESOURCE /STHEM (2) i 1 J 
RESOURCE/PI LOT ( 1 ) i 2 i 3 • 

»  «  START  THE  NAVIGATION  LEC  » 

STRT  CREATE! 

!  «  INITIATE  TASKS  REQUIRED  AT  THE  TURN  POINT  » 


ACT, 

,,turn; 

ACT, 

,,snpsr; 

ACT, 

,,CCLK! 

ACT, 

mChdg; 

ACT, 

,,CSPD! 

ACT, 

,,calt; 

ACT, 

mCcnav; 

ACT, 

,,clcdt; 

ACT, 

mCfuel; 

ACT, 

,,thrtl; 

!  «  THIS  DETERNINES  THE  LEG  TINE  LESS  120  SECONDS  » 

ACT,RNORN!3M.»9§.,5)  mNVLGT! 


J  «  DELAY  INITIATION  OF  LOPING  INPUTS  FOR  1  SEC  TO  » 

5  «  INSURE  LOOP  PARAMETERS  HAVE  BEEN  SET  » 

act.i.i.stecr; 

KTil.tlKU.NE.l.iFRSTi 

9 

!  «  SET  THE  THREAT  LEVEL  BASED  ON  THE  NAV  LEC/FEBE  TINE  » 
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i  «  ECU  ACTIVITY  LEVEL  SELECT  I  OH  » 
THRTL  ASSICN.XXI79)=XX(79)+1.; 

ACT..XX 179)  .EQ.  I .  iLVLOW! 

ACT. tXXI79) .EQ.Z. »LVHED! 
ACT>»XX(79).EQ.3.»LVVHi; 

ACT  > i XX (79) .CE . 4 . iLVH ! ! 

LVLOU  ASS1CK.XXI71)=420..XX(73)=0.; 
ACT... HALT. 

LVHED  ASSIGN. XX (71 ) =21A. .XX (73) =«. X 

ACT ...halt; 

LVVHI  ASSIGN. XX (71) =20. .XX (73) =.131 
ACT .210. 

ASSICN>XX(71)=52.5; 

ACT . . .HALT! 

LVHI  ASSIGN . XX (7 1 ) =52.5 . XX (73) =0. t 
ACT.. .halt; 


;  «  start  ech  loop  » 

STECH  ASSIGN. ATRIB(l) =999.. ATRIB(2!=XX(79); 

act.i.ech; 


;  «  initiate  reoccuring  task  sequences  on  the  first  lec  » 

FRST  ASSIGN. XX(I)=l.! 

act..,acclt; 

actm.sispr; 

■ 

» 

;  «  the  nav  lec  is  non  izb  seconds  from  completion  » 

NVLCT  goon; 
act; 

;  «  IF  APPROACHING  THE  END  OF  LEG  2  INITIATE  A  FENCE  CHECK  » 

ACT..XXI79) .EQ.2. .FNCEJ 

;  «  SET  THE  SNITCH  TO  STOP  THE  NAV  POINT  SEARCH  ROUTINE  » 

ASSIGN. XX (23) =i . ? 

!  «  CONPLETE  THIS  NAV  LEC  AND  START  THE  NEXT  LEG  » 

ACT,120.».STRTi 

5  «  INITIATE  THE  TASKS  REQUIRED  WHEN  APPROACHING  A  TURN  POINT  » 

ACT. 90. ..UP ins; 

act.i.cnhdg; 

act.i.trptr; 

;  <»»»»»»»)»»»»)»»»)»»»»»»»»»»»»»»» 

;  <  ALL  ASSIGN  NODES  THAT  ASSIGN  ATRIES  1.2  A  3  ARE  ASSIGNING  > 


*.  <  TASK  CODES . SERVICE  TINES  AND  PRIORITIES  RESPECTIVELY  > 
!  <  ATRIBU)  «  A  SERVICE  INDICATOR  FOR  MULTIPLE  SNITCHING  > 
I  <  BETWEEN  TASKS.... INDICATOR  VALUES  DEFINED  BELOW  > 
5  <  f.-NOT  SPECIFIED  DIVIDE  EASED  ON  SERVE  TIME  > 
J  <  I. -DO  NOT  DIVIDE  SERVE  TIME  > 
!  <  2. -DIVIDE  SERVE  TIME  INTO  2  PARTS  > 
!  <  3. -DIVIDE  SERVE  TIME  INTO  3  PARTS  ) 


122 


i  <  4. -DIVIDE  SERVE  TICE  INTO  4  PARTS  > 
i  <  5. -DIVIDE  SERVE  TIDE  INTO  5  PARTS  > 
;  <»»»»»»»»»»»»»»»»»»>»»»»»»»»»»»» 


»  «  CHECK  CLOCK  TASK  » 

CCLK  COON! 

ACT* 

ASSIGN,  ATRIB(lh2.,ATRIB(2hRN0RH(.&  >.2,7) t ATRIB (3) =3. » 
ATRIBMhi.il* 

5  «  IF  SWITCH  IS  SET  SEND  TASK  TO  COLCT  NODE  » 

ACT/51  ».)(X(2)  .EQ.l.iTODOi 
ACT! 

f  «  SET  THE  SWITCH  TO  PREVENT  MULTIPLES  OF  THIS  TASK  IN  THE  Q  » 
ASSIGN, XXI2hl.? 

ACT/2,,. TASKQi 

5  «  CROSSCHECK  AIRCRAFT  HEADING  TASK  » 

CHDG  coon; 
act; 

ASSIGN, ATRI8(lh3.,ATRI8<2hRNGRMU.8,  .6,7)  ,ATRIB(3h3., 
ATRI8(4hl.,l? 

;  «  IF  SWITCH  is  set  send  task  to  COLCT  NODE  » 

ACT /53,, XX (3) .EO.l.iTODO! 

act; 

!  «  SET  THE  SNITCH  TO  PREVENT  MULTIPLES  OF  THIS  TASK  IN  THE  Q  » 

ASSIGN* IX (31*1.5 
ACT/3,,, TASKO! 

i  «  CROSSCHECK  AIRCRAFT  SPEED  TASK  » 

cspd  goon; 
act; 

ASSIGN, ATRIB(lh4.,A7RIB(2hRN0R?m.8,. 6,7!  *ATRIB(3>=2., 

ATRIB (4) =1 . » 1 i 

J  «  IF  SHITCH  IS  SET  SEND  TASK  TO  COLCT  NODE  » 

ACT/54,  ,XXU).EQ.l.,TODO; 

act; 

;  «  SET  THE  SHITCH  TO  PREVENT  MULTIPLES  OF  THIS  TASK  IN  THE  0  » 

ASSIGN, XX (4) =1 . J 
ACT/4,,, TASKO? 

;  «  CROSSCHECK  AIRCRAFT  ALTITUDE  TASK  » 

CALT  COON! 

ACT? 

A$SICN,ATRIB(lh5.,ATRIB{2hRN0fN(1.8,.6,7>,ATRIB(3h3., 

ATRIBUhi.fi? 

5  «  IF  SHITCH  IS  SET  SEND  TASK  TO  COLCT  NODE  » 

ACT/55, ,XX(5).EQ. I. ,TODO; 
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act: 

i  «  SET  THE  SWITCH  TO  PREVENT  MULTIPLES  OF  THIS  TASK  IN  THE  0  » 
ASSIGN, XX<5)*l.i 
ACT/5,,, taskq: 

:  «  CHECK  NAV  LEG  TIME  TASK  » 

CCNAV  coon; 
act; 

ASSICN, ATRIB  <1 1 =&. , ATRIB (2) =RNQRM(1 .6, .6*71 » ATRIBI3) =1 . » 
ATRIBMI'1.,1; 

;  «  IF  SWITCH  IS  SET  SEND  TASK  TO  COLCT  NODE  » 

ACT/54, , XX (4) .EQ.l.,TODO; 

act; 

;  «  SET  THE  SWITCH  TO  PREVENT  MULTIPLES  OF  THIS  TASK  IN  THE  0  » 

ASSIGN, XX (41 =1 . > 

ACT/4,,, taskq; 

;  «  CROSSCHECK  NAV  LEG  DISTANCE  TASK  » 

CLGDT  COON! 

act; 

ASSICN,ATRIB(l)=7.,ATRIB(2)=RN0R!U.4,.2,7),ATRlBt3>=l., 

ATRIB (41 =1 . , i ! 

;  «  IF  SWITCH  IS  SET  SEND  TASK  TO  COLCT  NODE  » 

ACT/57,,  XX 17)  .EQ.l.,TODO; 

ACT! 

;  «  SET  THE  SWITCH  TO  PREVENT  MULTIPLES  OF  THIS  TASK  IN  THE  Q  » 

ASSICN, XXI7I-1.; 

ACT/7,, , TASKQ! 

;  «  CHECK  FUEL  TASK  » 

CFUEL  goon; 
act; 

ASSIGN,ATRIB(1)=8. ,ATRIB(2) =RN0RM( .4, .2,7) , ATRIB (3) =2, , 

ATRIB (4) =1 . , 1 ! 

;  «  IF  SWITCH  IS  SET  SEND  TASK  TO  COLCT  NODE  » 

ACT/58,, XX (8) .E0.1.,TOBO; 

act; 

;  «  SET  THE  SWITCH  Tu  PREVENT  MULTIPLES  OF  THIS  TASK  IN  THE  Q  » 

ASSIGN, XX(8)=1.; 

ACT/8,,, TASKQ5 

;  «  UPDATE  INS  CO-ORDINATES  TASK  » 

upins  coon; 
act; 

ASSIGN,ATRIB(l)=9. , ATRIB ( 2> =RN0RM( 10. ,2.,8) , ATRIB (3> =3. , 

ATRIB  U)--0.,i; 
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I 


«  IF  SWITCH  IS  SET  SEND  TASK  TO  COLCT  NODE  » 

ACT/59, ,XX19> .EQ.l. ,TOBO! 

ACT! 

!  «  SET  THE  SWITCH  TO  PREVENT  MULTIPLES  OF  THIS  TASK  IN  THE  0  » 

ASSIGN*  XX (9) =1 . • 

ACT/9,. , TASKS! 

• 

f  «CHECK  INS  ACCURACY  TASK  » 

CKINS  coon; 
act; 

ASSIGN*  ATRIBd  >  =11 .  >ATRIB(2)  =RN0RH<3.  *  .5*4)  *ATRIB(3)  =4.  * 

ATRIB (4 ) =1 . , 1 ? 

i  «  IF  SWITCH  IS  SET  SEND  TASK  TO  COLCT  NODE  » 

ACT/61,, XX (11) .EQ.l. iTODO! 

act; 

i  «  SET  THE  SWITCH  TO  PREVENT  MULTIPLES  OF  THIS  TASK  IN  THE  Q  » 
ASSIGN, XX(11)=1.; 

ACT/11,, .tasks; 

; 

,*  «  CROSSCHECK  (EXT  HOG  ON  CHART  TASK  » 

CNHDG  COON! 

act; 

ASSIGN, ATRIBI II =12. ,ATRI8(2)=RNORH(l .8, .6,7) ,ATRIB<3)=4. , 
ATRIH4)--l.,r, 

;  «  IF  SWITCH  IS  SET  SEND  TASK  TO  COLCT  NODE  » 

ACT/62, ,XX(1Z) .EQ.l. ,TODO» 

ACT*, 

;  «  SET  THE  SWITCH  TO  PREVENT  MULTIPLES  OF  THIS  TASK  IN  THE  8  » 

ASSIGN, XX(12)=1.; 

ACT/12,,, TASKS! 
r 

;  «  REVIEW  TURN  PT  ON  CHART  TASK  » 

TRPTR  COON! 

ACT! 

ASSIGN, ATRI8(1I=13.,ATRIB(2)=RN0RH<6., 1.5* 9) ,ATRIB(3) =3. * 

ATRIB  (4)  =A. ,  1 ; 

!  «  IF  SWITCH  IS  SET  SEND  TASK  TO  COLCT  NODE  » 

ACT/63, ,XX(131. EQ.l. ,TCDO! 

act; 

;  «  SET  THE  SWITCH  TO  PREVENT  MULTIPLES  OF  THIS  TASK  IN  THE  Q  » 

ASSIGN, XX(t3)=l.; 

ACT/13,,, tasks; 

I  «  CHANCE  IFF  CODE  » 

CIFF  CREATE, ,*. ! 

act; 
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ASSICNiATRIB tl J  =  14. .ATRIE(2>  =ftN0RM(6.4. -74»7) , ATRIB (3; -7. , 
flTRIB<4) =1 .  i 

ACT/14tUNFFH (0. > 1800. ,7) , ,TASKQ! 

i  «  OPS  CHECK  TASK  PARAMETERS  » 

STSPR  A$SICN,ATRIB<ll=19.,ATRIB(2)=RNGRH(3.,.5r7),ATRIB(3!=3.» 

ATRIB (4) =3. .li 

4 

f 

ACT/69»  *  XX (19) .EQ.1.»TQDQ! 

!  «  SET  SWITCH  TO  PREVENT  MULTIPLES  OF  THIS  TASK  IN  THE  Q  » 

ACT! 

assign, mi9i=i.; 

4 
1 

ACT/19,, »7ASK9! 

» 

!  «  HARK  COMPLETION  OF  OPS  CHECK  » 

STSLC  ASSIGN* XX (55) =USERF (41! 

ACT  * > (HALT! 

i  «  RELEASE  THE  SWITCH  TO  ALLOW  THE  NAV  POINT  SEARCH  ROUTINE  » 
SNPSR  ASSIGN, XX<23» =8. . ATRIB ( U =XX(79) t 
ACT! 

5  «  NAV  POINT  SEARCH  ROUTINE  » 

NPSRH  COON.l! 

i  «  STOP  NAV  SEARCH  ROUTINES  FROM  PREVIUOS  LEGS  » 

ACT,, ATRIB! It. EO. XX (79) ! 

ACT,,, HALT! 

COON 

!  «  LOOK  FOR  A  NAV  POINT  EVERT  240  SECONDS  » 

ACT  *  RNORH (Z40 . , 15. ,7) ,XX(23) .EO.0. , NPSRH! 

!  «  DON'T  ALLOW  A  NAV  PT  SEARCH  WITHIN  120  SEC  OF  NEXT  TURN  PT  » 

ACT, ,XX(23) .EQ.l. , HALT! 

ACT,,XXI23).EQ.0.', 

A$SICN,ATRIB(1) =22. »ATRIB(2)=RNORN(6.» 1.5,2)  »ATF.IB(3):4. , 
ATRIB(4)=0.,2! 

ACT , , ,CKINS» 

!  «  DON’T  ALLOW  ANOTHER  SEARCH  TASK  IN  THE  Q  UNTIL  THE  » 

!  «  LAST  ONE  IS  COMPLETED  » 

!  «  IF  SWITCH  IS  SET  SEND  TASK  TO  COLCT  NODE  THROUGH  NVSW  » 

ACT,, XX(Z2).EQ.l, NVSW! 

ACT! 

!  «  SET  THE  SWITCH  TO  PREVENT  MULTIPLES  OF  THIS  TASK  IN  THE  Q  » 

ASSIGN, XX (22! =1 . f 
ACT/22,,, TASKO! 

I 

!  «  SET  NAV  POINT  SWITCH  TO  "NSEEN"  IF  NAV  POINT  SEARCH  » 

!  «  TASK  WAS  NOT  ACCOMPLISHED  WHEN  A  NEW  ONE  WAS  DUE  » 

NVSW  AS$ICN,IX(2l)=0.! 

ACT/64, ,,TODO! 


5  «  AIRCRAFT  CONTROL  TACK  » 

ACCLT  COON 

ACT! 

ASSIGN.ATRIBU)  -30.  »ATRIB(2)  =l)SERFU>  »ATRIB{3>=7.  t 
ATR1B(4I=1.J 
ACT/38.,, CRITTJ 
ACT ,ATRIB (2) J 

coon; 

ACT»XX(62)»»ACCLT» 

;  «  TURN  TO  NEW  HEADING  TASK  » 

TURN  coon; 
act; 

ASSIGN,ATRIB(1)=48.»ATRIB(2)IRN0RM(1B.,9,»1) ,ATR1B(3)S8., 
ATRIB (4) -1 . r 
ACT/48,,, CRITTJ 

;  «  fence  check  task  »; 

FNCE  ASSIGN, ATRIB I 1 > =74. , ATRIBI2) =RN0RM(2B.5» 7.52, 7), ATRIB<3)=5., 
atrib<4)=0.; 
act,,,taskq; 

» 

s  «  defensive  maneuver  task  » 

;  «  defensive  maneuver  and  set  stress  snitch  for  the  » 

i  «  defensive  maneuver  » 

defm  coon; 

• 

I 

act; 

ASSIGN, XX(75)=XX(75)+l.f 
acttmHAnv; 

! 

5  «  AFTER  18  MIN.  STRESS  FROM  DEFENSIVE  MANEUVER  IS  CONE  » 

ACT, 688. , iSADJ! 

SADJ  ASSIGN, m75)=XX< 75) -1.; 

ACT,,, halt; 

HANV  ASSIGN, ATRIB ( 1 ) =75. ,ATRIB(2)=RN0RM(38.,5.,5I,ATRIB(3)=9., 
ATRIB  441  =  l . ! 

ACT/75, mCRITT! 

;  <'  ECM  TASK  » 

ECHLS  ASSIGN, ATRIB(1):£.! 

ACT? 

ECM  COON, 1 ; 

J  «  STOP  THE  LOOP  OF  PREVIOUS  LEGS  » 

ACT,, ATRIB (2) .NE. XX (7?t, HALT? 

ACT! 

!  «  NOTE  THE  LEG  THE  INTITT  NAS  GERERATED  ON  » 

ASSIGN, ATRIB (2) :XX (79) J 
ACT,EXP0N(XX(71) ,6) iiECMLS! 

5  «  LET  SERVICE  OF  THE  TASK  DIE  IF  IT  IS  A  LOOP  STARTER  » 


ACT,,ATRIB(1).N£.999.; 

ECHPR  ASStCN.ATRIB (l)=76. tflTRIB <2>  =U£ERF (2J ,ATRIE(3)=7., 
ATRIB(4l =2. »XX(74)=DRAND<7) f 

!  «  TEST  TO  SEE  IF  A  DEFENSIVE  MANEUVER  IS  REQUIRED  » 

ACT., XXI741.LT. XX(73) >DEFHi 
ACT/74,, , TASKS. 

J  «  SET  THE  ECM  STRESS  FACTOR  » 
act.mECnsf; 

I 

I 

!  «  ADJUST  STRESS  FACTOR  FOR  ECM  IMPUTS  » 

ECMSF  ASSIGN. XX (74)  =  XX<74)  *  ATRIB(2)! 

ACT. 120. 

ASSIGN. XX (74)  =  XX<74)-  ATRIB(2)i 
ACT... HALT*. 


!  «  FUEL  SWITCHING  TASK  » 

GASH  CREATE. .0.. 15 
ACT,* 

ASSIGN.  ATRIB(l)  =81 . .  ATRIB<2)  =RNORM(l .  I .  .74.7) .  ATRIBO)  =4. . 
ATRIB(4) =1 . * 

ACT/81 (RNORH (900. .100. .7).. TASKS . 

f  <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 

!  «  QUEUEING  STSTEM  FOR  AIRCRAFT  CONTROL.  TURN  AND  » 

i  «  DEFENSIVE  MANEUVER  TASKS  » 

.’  <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 

CRITT  goon; 
act; 

ACT... TODD ; 

PREEHPT(2)/HIGH(3) .PILOT..4J 
act; 

;  «  CHECK  FOR  THE  PROBABILITY  OF  AN  ERROR  DUE  TO  » 

i  «  STRESS--IF  ERROR  SEND  TWO  TASKS  BACK  FOR  » 

I  «  SERVICE-ONE  TO  CORRECT  ERROR  AND  ONE  TO  APPLT  » 

{  «  THE  PROPER  CONTROL  INPUT  » 

EVENT, 1! 

act; 

SKIP  ASSIGN, XX(94)=DRAND(7),XX(78!=XX(97)-.03i 
ACT, ,XX(94).LT.XX(7S), CRITT! 

ACT, ,XX(94).LT.XX(78), CRITT! 

ACT/31, ATRIB(Z),,RELCi 

act; 

ASSICN,ATRIB(2)=ATRIB(2)-.001,1» 

ACT , ATRIB (2 ) .ATRIB(l) .EO.40..OR.ATRIB(1).EQ.75. . ADJCT » 

ACT,,, halt; 

5  «  TASK  QUEUE  » 

■ 

I 

I  «  RESOURCE  SThEM  (SHORT  TERM  MEMORT)  ALLOWS  2  TASKS  IN  » 
i  «  THE  MULTIPROCESSING  SCHEME  AT  ONE  TIKE  » 

TASKQ  COON! 

actm.tooo; 

ACT! 

auait(1),stmem; 

actm.strss; 
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» 

i  «  REACCOMPL I SH  TASKS  EASED  ON  STRESS  TEST  » 

STOSS  EVENT ,  1 , 1  i 
ACT! 

OUT  ASS!CN»XX(96) =0RAND(7) • 

5  «  IF  THE  RANDOM  NUMBER  IS  LESS  THAN  THE  STRESS  » 
i  «  TOTAL  1X1(97) I  REACCOMPLISH  THE  TASK  » 

ACT , , XX (96) .LT . XX (97 ) , TASKQ? 

act; 

cooNfi; 

i 

i  «  MULTIPLE  SWITCHING  BETWEEN  TASKS  SCHEME  » 

I 

!  «  ATRI8I4)  INDICATES  MULTIPLE  SERVICE  SPECIFICATIONS  » 

ACT,,ATRI8(4).E0.1., ASCI! 

ACT, » ATRIB (4) .EQ.2.,ASC2i 
ACT,,ATRIB(4).EQ.3.fASG3! 

t 

i  «  IF  MULTIPLE  SERVICE  SCHEME  IS  NOT  SPECIFIED  BREAK  THE  » 

?  «  SERVICE  UP  BASED  ON  TASK  TIME  » 

ACT , »ATRIB 12) .LE.3. , ASCI ! 

ACT,,ATRIB(2) .LE.6..ASG2! 

ACT,,ATRIB(2).LE.12.,ASG3i 

ACT,,ATRIB(2).LE.24.,A$G4» 

ACT , r ATRIB (2) .CT.24.,ASG5! 

» 

5  «  ATRIB(5)  --  NUMBER  OF  TIMES  THE  TASK  MUST  BE  PROCESSED  » 

5  «  TO  COMPLETE  THE  SERVICE  » 

ASG1  ASSIGN, ATRIB(5>l.f 
ACT, , , SERVO! 

ASC2  ASSIGN, ATRIB (5) =2. , ATRIB(2) =ATRIB(2) II . ! 

ACT,,, SERVO! 

ASC3  ASSIGN, ATRIB(51 =3., Ai?IB(2)=ATRIB(2) /3.» 

ACT,,, SERVO! 

ASG4  ASSIGN, ATRIB (5) '4. ,ATRIB(2) =ATR1B(2) /4. ! 

ACT,,, SERVO! 

ASCS  ASSIGN, ATRIB (5) =5., ATRIB(2) =ATRIB (21/5.5 
ACT,,, SERVO! 
r 

;  «  TASKS  ARE  SERVICED  SERIALLY  BT  RESOURCE  PILOT  » 

SERVO  ASSIGN, ATRIB(6) =ATRIB(2) J 
ACT! 

AWAITI3), PILOT! 

ACTIVITT/l, ATRIB (6) , ,SEL! 

REL  FREE, PILOT/1 ! 

ACT , , ,ACOHP! 

act; 

5 

f  «  ADJUST  AND  CHECK  SERVICE  COUNTER  ?T!D  » 

J  «  SEND  IT  BACK  FOP  ’(ORE  SERVICE  if  REQUIRED  » 

J  «  IF  THE  TASK  IS  COMPLETE  ALLOW  ANOTHER  TASK  » 

?  «  TO  ENTER  THE  SERVICE  SC'.IEiv;  » 

ADJST  ASSIGN, ATRIB (51 =ATRIt , V -I..;! 

ACT,, ATRIB (5) .GT.W., SERVO; 


129 


ACT,, ATRIBI5I.EQ.0., MORE! 

MORE  FREEtSTHEH/l', 

ACTmSYSCKi 

I 

•  «  IF  COMPLETED  TASK  IS  A  OPS  CHECK  HARK  THE  COMPLETION  TIKE  » 

ACTuATRIB(l)  .EQ.19.  rSTSLCi 

I 

I  «  IF  THE  COMPLETED  TASK  IS  A  NAV  POINT  SEARCH  » 

!  «  CHECK  SUCCESS  OF  THE  NAV  PT  SEARCH  » 

ACTnATRlB(l)  .EQ.ZZ.tSEEPTJ 

f 

J  «  RELEASE  RESOURCES  THAT  PREEMPTED  OTHER  TASKS  » 

RELC  FREE. PILOT/1 i 
ACTm.ACOMPJ 

4 

I 

J  «  REMOVE  FLT  CONT  TASKS  INPUT  DURINC  TURNS» 

5  «  &  DEF  MANEUVERS  » 

ADJCT  EVENT. 3. 

ACT.. .HALT. 

I 

5  «  DETERMINE  IF  AN  OPS  CHECK  IS  APPROPRIATE  » 

STSCK  ASSICNf XX t55)  =OSERF (3) »2» 

ACT,,XX(55).£Q.1..STSPR; 

t 

!  «  SEND  COMPLETED  TASKS  TO  RELEASE  SNITCHES  » 

ACT»»ATRIB(l).E9.2..A02i 
ACT,,ATRIB(l).EQ.3.,A03! 

ACT«,ATRI8Ul.EO.4.,A045 
ACT. >ATRIB(i) .EQ.S»«A05t 
acti.atrib(u.eq.6..a0s; 

ACT » . ATRIB(l) .EQ.7. ,A075 
ACT..ATRIB11) .EQ.8..A08. 

ACT,,ATRIBU).£Q.9.,A09! 

ACT.iATRIB(t).EO.ll. .All! 

ACT»»ATRIBU).E0.12.,A12; 

ACT . tATRIB(l) .E0.l3.iAl3f 
ACT».ATRIB(U.EQ.19..A19» 

ACT. .ATRIB(l) .E6.22. .A22I 

* 

1 

i  U  CHECK  SUCCESS  OF  THE  NAV  POINT  SEARCH  » 

5  «  SUM  THE  SERVICE  TIMES  OF  ALL  TASKS  PRESENTED  » 

TODO  EVENT, 5! 

ACT,,, HALT! 

f 

f 

!  «  SUM  THE  SERVICE  TIMES  OF  ALL  TASKS  ACCOMPLISHED  » 

ACQHP  EVENT, 

act; 

HALT  TERMINATE; 

5  «  THESE  NODES  RELEASE  THE  NO  MULTIPLE  TASK  SWITCHES  » 

A#2  ASSIGN, H (2) -B.i 
ACT,,, STOP! 

A03  ASSIGN, XX (3) =0 . ! 

ACT,,, STOP? 
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m  ASSIGN, XX(4)=0,! 

ACTm.STOP! 

A05  ASSIGN, XX (5) =0 . ■ 

ACTm.STOP! 

A04  ASSIGN, XX (6) =0. T 
ACTm.STOP! 

A07  ASS1GN,XX17)=8.! 

ACT,,, stop; 

A08  ASSIGN, XX (8)=0. , 

ACT,,, STOP! 

A09  ASSIGN, XX(9>=«.J 
ACTm.STOP! 

All  ASSIGN, XX (1 1 ) =0. ! 

ACTm.STOP! 

A12  ASSICN,XX(12)=0.i 
ACTm.STOP! 

A13  ASSIGN, XX ( 13) =0.! 

ACTm.STOP! 

A19  ASSIGN, XX ( 19) =0. ? 

ACTm.STOP! 

A22  ASSIGN, XX (22) =§. 5 
ACTm.STOP! 

STOP  TERMINATE ! 

ENDNETNORK! 

f 

i  «  RUN  LENGTH  » 

INIT»0.,1800.» 

■ 

!  «  INITIALIZE  PARAMETERS  FOR  FUa  SNITCHING  AND  » 

!  «  STRESS  SNITCHES  FOR  DEF  MAN VS,  STS  MAL  AND  » 

!  «  NAV  POINT  SEARCH  SUCCESS  » 

INTLC,XX(75)=0. ,XX(l)=0.,XX(74)I0.,XX(2ll=l.»XX(79)=0.! 

!  «  NECATIVE  SEEDS  FOR  HALF  TOTAL  RUNS  &  POSITIVE  » 

!  «  SEEDS  FOR  THE  REMAINDER  TO  USE  ANTITHETIC  » 

!  «  REDUCTION  TECHNIQUE  » 

SEEDS , -69578 ,-40961, -93969 ,-61129,-43211 , -97336 , 
-47584,-12245,-21382,-54092! 

SIMULATE 

SIMULATE 

SIMULATE 

SIMULATE 

SIMULATE 

SIMULATE 

SIMULATE 

SIMULATE 

SIMULATE 

SIMULATE 

SIMULATE 

SEEDS ,49578,40941 ,93949 ,41129, 43211 , (7334, 
47584,12245,21382,54092! 

FIN! 
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Distribution  Tests 


This  appendix  contains  six  statistical  tests  that 
were  used  to  confirm  the  results  of  the  input  distribu¬ 
tions  specified  in  the  model.  Six  Kolmogorov-Smirnov  tests 
were  used  to  test  the  distributions  for  navigation  leg 
lengths,  navigation  point  search  spacing,  navigation  task 
service  times,  turn  service  times,  and  flight  control 
task  times. 
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Leg  Length 


H« :  The  leg  lengths  are  from  a  Normal  (4  20. ,90.) 
distribution. 

Hji  The  leg  lengths  are  not  from  a  Normal  (420., 90.) 
distribution . 

.  KOLMOGOROV  -  SMIRNOV  GOODNESS  OF  FIT  TEST 

TIME 

TEST  BIST.  -  NORMAL  (MEAN  =  420.0000  STD.  DEV.  =  90.0000) 


CASES 

MAX  CABS  DIFF) 

MAX (+  DIFF) 

MAXI-  DIFF) 

4 

.4911 

.4911 

-.2303 

K-S  Z 

2-TAILED  P 

.982 

.289 

.624  >  .4911;  therefore,  fail  to  reject  HQ  at 
alpha  equal  to  .05. 


Time  Between  Nav  Points 

HqJ  The  time  between  searching  for  nav  points  is 
from  a  Normal  (240., 15.)  distribution. 

H.  The  time  between  searching  for  nav  points  is 
not  from  a  Normal  (240.,  15.)  distribution. 


-  -  -  KOLMOGOROV  -  SMIRNOV  GOODNESS  OF  FIT  TEST 
TIME 


ST  DIST.  -  NORMAL 

(MEAN  =  240.0000  STD.  DEV.  = 

15.0000) 

CASES 

MAXIABS  DIFF) 

NAXI+  DIFF) 

MAXI-  DIFF) 

11 

.3220 

.2138 

-.3220 

K-S  Z 

2-TAILED  P 

1.048 

.214 

.391  >  .3220;  therefore,  fail  to  reject  HQ  at 
alpha  equal  to  .05. 
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Navigation  Service  Times 


Hn:  The  time  required  to  find  a  nav  point  once 
0  search  begins  is  from  a  Normal  (6. ,1.5)  dis¬ 
tribution  . 

H. :  The  time  required  to  find  a  nav  point  once 
search  begins  is  not  from  a  Normal  (6. ,1.5) 
distribution . 

.  KOLMOGOROV  -  SMIRNOV  GOODNESS  OF  FIT  TEST 

TINE 

TEST  D1ST.  -  NORNAL  (NEAN  =  6 .0000  STD.  DEV.  =  1.5000) 


CASES 

HAXfABS  DIFF) 

KAX(+  DIFF) 

MAX(-  DIFF) 

12 

.1507 

.1476 

-.1507 

K-S  Z 

2-TAILED  P 

.522 

.948 

.375  >  .1507;  therefore,  fail  to  reject  H_  at 
alpha  equal  to  .05. 


Turn  Servicing  Time 


H0:  The  time  required  to  complete  a  turn  is  from 

a  Normal  (18.9.)  distribution. 

H, :  The  time  required  to  complete  a  turn  is  not 

from  a  Normal  (18., 9.)  distribution. 


-  -  KOLMOGOROV  -  SHIRNOV  GOODNESS  OF  FIT  TEST 


TINE 

TEST  BIST.  -  NORNAL  (MEAN  =  18.0000  STD.  DEV.  *  9.0000) 

CASES  MAX (ADS  DIFFI  HAX(+  DIFF)  KAX(-  DIFF) 
5  .3622  .3622  -.2331 


K-S  Z  2-TAILED  P 

.811  .528 


.565  >  .3622;  therefore,  fail  to  reject  Hq  at 
alpha  equal  to  .05. 
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Flight  Control  Movements 

H_:  The  periods  of  flight  control  movements  are 
0  from  the  empirical  data  used  in  the  program 
for  movement  periods. 

H1 :  The  periods  of  flight  control  movements  are 
1  not  from  the  empirical  data  used  in  the  program 
for  movement  periods. 


1.  =  2.  HAX  (ABS  DIFF1  MfiX  (+  DIFF>  HAK-  BIFF) 

458  66  .1881  .1888  -.8388 

K-S  Z  2-TAILED  P 

.821  .511 


.1274  >  .1080;  therefore,  fail  to  reject  H.  at 
alpha  equal  to  .05.  ,J 


Flight  Control  Non-Movements 

H_ :  The  periods  of  flight  control  non-movements  are 
from  the  empirical  data  used  in  the  program  for 
non-movement  periods. 

H. ;  The  periods  of  flight  control  non-movements  are 
not  from  the  empirical  daca  used  in  the  program 
for  non-movement  periods. 


I.  s  2.  HAUABS  BIFFi  «A*(+  D1FF)  HAII-  D1FF) 
458  28  .1793  .1793  -.8408 

K-S  Z  Z-TAILEB  P 

.785  .569 


.2026  >  .1793;  therefore,  fail  to  reject  H~  at 
alpha  equal  to  .05. 
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Appendix  D 


ECM  Task  Initiation  Data 


This  appendix  contains  a  table  of  the  data  deter¬ 
mined  from  the  threat  array  model. 
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DEFENSIVE  REACTION  TASK  INITIATION  DATA 


Altitude 

Range 

Total* 

A 

B 

C 

D 

1000 

142 

64 

42 

32 

248 

(57%) 

(26%) 

(17%) 

(13%) 

(100%)** 

500 

64 

97 

7 

1 

168 

(38%) 

(58%) 

(4%) 

(.5%) 

(68%)** 

250 

42 

38 

2 

0 

82 

(52%) 

(46%) 

(2%) 

(0%) 

(33%)** 

*Total  =  A  +  B  +  C 

A  =  -01  to  .10 
B  =  -10  to  .20 
C  =  .20  and  greater 
D  =  .30  and  greater 

**This  percentage  is  the  total  for  that  altitude 
divided  by  the  1000  foot  total. 


Appendix  E 

FORTRAN  Program  for  Aircraft  Control  Movements 

This  appendix  contains  the  flow  diagrams,  FORTRAN 
code  listing  and  an  example  verification  run  of  the  program 
used  to  reduce  raw  data  of  stick  position  to  periods  of 
movement  and  non-movement.  Voltages  for  the  verification 
run  are  in  thousands  because  actual  data  was  divided  by 
ten  before  the  results  were  recorded. 
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Fig.  E-l.  Flow  Chart  (Recorded  Data  Section) 


Flow  Chart  (Set  Pitch  and  Bank  Base) 


I  Stick  Movements) 


PROGRAM  DISTRI  (INPUT, OUTPUT, TAPE5, TAPES, .AFE7) 

DIMENSION  PSTIK(S2ffl!  >!NMNT(522)  ,l;'.3VE(5JJ)  iBSTI  ;j,:j 

C 

c 

INI  FCfiMATI10liF9.5ilXiF18.5il5It2F5.3l 
1W2  FORMAT  11^121  ilt)) 

G 

M=t 

NNN-I 

C 

C  (HHmimHMHIHHiHHHIHIHHIHIHliHHHtHiHH 

C 

C  DO  LOOP  30  READS  DATA  AND  DETERMINES  WHETHER  OR  NOT 

C  AIRCRAFT  IS  IN  A  RECORD  BLOCK.  NN  CHANCES  EASED  ON 

C  NUMBER  OF  DATA  POINTS 

C 

C  mmmhhmhhmhhmhmhhhmmhhhmmhhhhhh 

C 

NN *6900 
DO  30  1=1. NN 

READ 15 i 1 081 )  ALAT . ALONG . BMOVE iPKOVE 
1F1ALAT.CT. (3t.31St> .AND.ALAT.LT. (3fc.45> 

MND.ALONC.CT. (-11.351 .OR. 

<ALAT.GT. (36.5) .AND.ALAT.LT. (36.65) 

». AND. ALONG. CT. 1-11. 25). OR. 

♦ALAT.CT. (36.6833) .AND.ALAT.LT. (36.7333) 

*. AND. ALGNG.CT. (-11,251  .OR. 

*ALAT.GT. (36. 66667). AND. 

< ALONG . CT . < - l 1 . 35 ) . AND . ALONG . LT . ( - l 1 . 26667 ) . OR . 

♦ALAT.CT. (36.25) .AND.ALAT.LT. (36.65) 
i.AND.ALONG.lT. (-11. 35833))  CO  TO  31 
CO  TO  38 

31  BSTIK(M) sBHOVE 
PSTIK(H)=PMOVE 
H=K*1 

3#  CONTINUE 
C 

KK=0 

m--t 

c 

NWMM 

C 

C  M04M<M<MMMMHMMMMMMMM<MMM<M<M<M<0MMM 

c 

C  J»  TRACKS  THE  NUHEER  OF  MOVEMENTS  IN  THE  DISTRIBUTION 

C  JJi  TRACKS  THE  Nl'MEER  OF  NO  MOVEMENTS  IN  THE  DISTRIBUTION 

C  lit  RESETS  THE  COUNTER  FOR  TRACK  INC  LENGTH  OF  MG, INERT 

C  AND  LENGTH  OF  NON-MOVEMENT 

C  IMARK.  DEFINES  WHETHER  THE  STRING  BUILDING  IS  A  MOVEMENT 

C  OR  NON-MOVEMENT 


C  IBACPi  ESTABLISHES  THE  EASE  FCR  PITCH 

C  1  EASE i  ESTABLISHES  THE  EASE  FOR  E'A.-iK 

C  ICKMV.  SERVES  AS  A  POINT  WHICH  ESTABLISHES  THE  ILCINNINC  OF 

C  MOVEMENT  OR  NON-MOVEMENT 

C  PCEKUi  UPPER  LIMIT  FOR  CHECKING  NEED  FOR  PITCH  EASE  CHANGE 

C  PCEKLi  LOSER  LIMIT  FOR  CHECKING  NEED  FOR  P1TC-'  EASE  CHANGE 

C  BCEKUi  UPPER  LIMIT  FOR  CHECKING  NEED  FOR  BANK  EASE  CHANGE 

C  BCEKLi  LONER  LIMIT  FOR  CHECKING  NEED  FOR  BANK  BASE  CHANCE 

C  PEODUi  PITCH  EASE  BOUNDS!  UPPER  LIMIT 

C  PBODLt  PITCH  EASE  COUNDR T  LONER  LIMIT 

C  EBODUr  BANK  BASE  BOUNDS!  UPPER  LIMIT 

C  BBODLi  BANK  BASE  BOUNDRI  LONER  LIMIT 

C  I WORK i  IDENTIFIES  THE  STRINC  BEING  BUILT  AS  MOVEMENT 

C  NWORKi  IDENTRFIES  THE  STRINC  BEING  BUILT  AS  NON-MOVEMENT 

C 

C  IHHHiHiHHHHHHHHHHHHHIHiHHHHKHHHHHf 

M 

JJ=1 

Il-f 

IMARK^J 

IBASP=» 

IBAS8-0 

ICKHV-4 

PCEKU--U 

PCEKL-4 

BCEKUI 

BCEKL-tf 


PBODU-.MZ 

PB0BL=-.e«2 

BEODU-.88Z 

BBODL=-.MZ 

IUORK'O 

NWORK-d 

C 

l«t 

C 

C 

C  MHHHItHHKMMHHHHMHHHHHHHHtHmHHIKHHi 

c 

C  4  -  START  Of  A  LOOP  WHICH  CHECKS  EACH  PITCH  AND  BANK  VOLTAGE 

C  DETERMINES  IF  IT  IS  A  MOVEMENT  OR  NON-MOVEMENT 

C 

C  HHIIHiillHKHIIHHHHHHHHHHHHHIHHlimiHIHH 

C 

4  PBILD-I 
BBILD-B 
IP=t*l 

IFU.CT.NNNI  W  TO  U 
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c 

C  (iiHiiiiiiiiimmiiitmHiiiittiiiiHtiHHi.itmititimt 
C  DETER«l«£  AVERAGE  VOLTAGE  FOR  VlTNONHl  THRU  IVITNUM) 

C  IN  FITCH  AND  BANK 

C  UmiHiHHHHHUHHHIHiHHilHHHHiHHHIHHIHlH 

C 

00  Hi  K=ltb 
PBII&--PB11B*PST1KIIP! 

BBILD-BB1LD+BSTIKIIP) 

IP-IP+1 
Hi  CONTINUE 

PCHEK--PBILB/G 

BCHEKsBBllB/b 

PCEKU-PCHEK+.002 

PCEKL'PCHEK-,0152 

BCEKU=BCH£K+.002 

BC£KL=BCH£K-.082 

C 

C 

IP*I+1 

c 

C  IHHimMHHHHHHHIIIHiHiHHHiHIHinHHHmiHmi 

c 

C  DO  LOOP  128  CHECHES  FOR  BASE  CHANCE  IN  PITCH 

C  00  LOOP  211  CHECKS  FOR  BASE  CHANCE  IN  BANK 

C 

C 

DO  128  K*-1»S 

IFIPSTIKtIPI .CT.PCEKU.OR.PSTIKIIP) .LT.PCEKL)  CO  TO  40 
lP=IP+i 
12i  CONTINUE 
C 

IF  (PBODU . E9 . PCEKU . AND . PEQDl, Efl . PCEKL 1  CO  TO  48 
PBODU-PCEKU 
PEODLsPCEKL 
IBASP-IEASP+I 
C 

41  IP*I+1 

DO  121  K=1.6 

1FIBST1KUP)  .CT.BCEKU.OR.BSTIKIIPI.LT.ECEKLI  CO  TO  43 
IPMP+1 
121  CONTINUE 
C 

IF (BBODU . EQ . BCEKU . AND , EEODL . E3 . BCEKL ! CO  TO  43 

BBOOU-BCEKU 

BBODL-BCEKL 

IBASB-IBASE+1 
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C  4444444444444444444444444444444444444444444444444444444444444444 

G 

C  THE  FOLLOWING  IF  STATEMENT  DETERMINES  WHETHER  OR  NOT 

C  THE  STICK  IS  MOVING 

C 

G  4444444444444444444444444444444444444444444444444444444444444444 

43  IF (PSTIK ( I > .CT.PSODU.OR.PSTIK ( I ) .LT.PEODL 
4.0R.BST1K tl) .GT.BEODU.OR.BSTIKii ) -LT.BBODL)  GO  TO  41 

C 

C  44444444444444444444444444444444444444144444444444444444444444 

c 

C  THE  FOLLOWING  SECTION  TRACKS  NON-MOVEMENT  PERIODS 

C 

C  44444444444444414444444444414444444444444444444444444444444444 

C 

IF ( ( I MARK . EO . 2 . OR . I MARK . EQ . 0 ) 

4.AND. (IWORK.EQ.O.AND.NWORK.EQ.fU  CO  TO  42 
C 

IFIIWORK.CT.fi  GO  TO  142 
CO  TO  141 
142  It-M+IKQRK 
IWORK-f 
CO  TO  42 
C 

141  IF(NWORK.LE.l)  GO  TO  44 
IHOVEUMII-ICKHV 
ICKMV=II 
IM1+NW0RK 
NUORK-tf 
J-J+l 

♦2  1*1+1 
11*11+1 

1FII.CT.NNNI  CO  TO  91 
1MARK-2 
CO  TO  4 
C 

44  NW0RK*NW0RK+1 
1*1+1 

CO  TO  4 
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C 

C  TIE  FOLLOWING  SECTION  TRACKS  MOVEMENT  PERIODS 

C 

C  IHIHIimHilHHHMHIHHHHMHHHHHHIHHiHIHHH 

C 

41  IF ( d HARK. £3. 1 .OR. IHARK. E9.0) 

*.AND.  (IWORK.EQ.0.AND.NNORK.EQJ))  CO  TO  SI 
C 

IF (NUORK.CT .8)  CO  TO  U4 
CO  TO  US 

144  IIM1+NW0RK 
NU0RK-# 

CO  TO  SI 
C 

145  IFdilORK.LE.l)  CO  TO  47 
IHKNTUJMl-lCKSW 
ICKMV-I I 

II=I I+IWORK 
IWORK=i 
JJ-JJ+1 
51  I-Ul 
11*11*1 

IFd.CT.NNNI  CO  TO  91 
IHARK5 l 
CO  TO  4 
C 

47  IWORKdWORK+l 
1*1*1 
CO  TO  4 
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c 

91  J=J-t 
JJ=JJ-1 
IBAL=II-ICKMV 
IA-8 
IB-0 
IAA-0 
C 

DO  200  1*1, J 
IA=I A+IKOVE ( I ) 

200  CONTINUE 

DO  210  1=1, JJ 
IB=IB+INKNT (I) 

210  CONTINUE 
C 

IAA=IA+IB 

C 

PRINT*, "  " 

PRINT*,"  " 

PRINT*, "NUMBER  OF  TIMES  THE  PITCH  BASE  NAS  CHANCED  =",IBASP 
PRINT*, "NUMBER  OF  TIMES  THE  BANK  BASE  HAS  CHANGED  =",IBASB 
PRINT*,"  " 

PRINT* »"NUHBER  OF  PERIODS  OF  MOVEMENT  =",J 
.  PRINT*, "NUMBER  OF  PERIODS  OF  NO  MOVEMENT  ="»JJ 
PRINT*,"  " 

PRINT*, "NUMEER  OF  TENTHS  OF  SECONDS  =  ",IAA 

PRINT*,"  " 

PRINT*,"  NUMBER  OF  TENTHS  NOT  ACCOUNTED  FOR  =  M8AL 
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c 

c 

KKK=J 

K'10 

C 

«ftITE(6t*)"  250  FEET •  PILOT  3»«0VE^1ENTS“ 

C 

80  WRITEU>.1032)  (IROVE(KXbKK-HtK) 

J-J-10 

N-N+10 

K=K+10 

IFU.CE.10)  CO  TO  80 
IF(J.LT.10.flNQ.J.GE,8)  GO  TO  82 
CO  TO  81 
82  K=KXK 
GO  TO  80 
C 
C 

81  KKK-J-J 

KRITE(7i*)"  250  FEET.  PILOT  3  .NO  MOVEMENTS” 

N=1 

KM0 

90  WRITE (7 » 1 332)  (IMNT(KK).KK=N>K> 

JJUJ-10 

N-N+10 

KIK+10 

IFUJ.GE.10)  CO  TO  90 
IFUJ.LT.10.AND.JJ.GE.0)  CO  TO  92 
CO  TO  150 
92  K-KKK 
CO  TO  90 
C 

150  STQP 
EHD 


tONG  BANK  PITCH 


36.4 

-11.4 

.300 

.000“ 

36.4 

-11.4 

.880 

34.4 

-11.4 

.000 

.000 

.  6  sec 

no  movement 

36.4 

-11.4 

.000 

.808 

36.4 

-11.4 

.000 

.800 

36.4 

-11.4 

.001 

.801 

36.4 

-11.4 

.003 

.803 

36.4 

-11.4 

.005 

.005 

36.4 

-11.4 

.007 

.007 

.  9  sec 

movement 

36.4 

-11.4 

.018 

.018 

36.4 

-11.4 

.018 

.018 

36.4 

-11.4 

.019 

.019 

36.4 

-11.4 

.017 

.017 

36.4 

-11.4 

.013 

.013 

36.4 

-11.4 

.005 

.005 

36.4 

-11.4 

.000 

.000 

36.4 

-11.4 

.080 

.000 

.  8  sec 

36.4 

-11.4 

.000 

.830 

no  movement 

36.4 

-11.4 

.000 

.800 

36.4 

-11.4 

.000 

.800 

36.4 

-11.4 

.007 

.007 

36.4 

-11.4 

.007 

.007 

36.4 

-11.4 

.000 

.800 

36.4 

-11.4 

.003 

.003 

36.4 

-11.4 

.005 

.005 

36.4 

-11.4 

.007 

.007 

.  9  sec 

movement 

36.4 

-11.4 

.008 

.008 

36.4 

-11.4 

.001 

.001 

36.4 

-11.4 

.005 

.005 

36.4 

-11.4 

.030 

.030 

36.4 

-11.4 

-.004 

-.004 

36.4 

-11.4 

-.006 

-.006 

Fig.  E-5.  FORTRAN  Program  Verification  Data 


CONTINUED 


34.4 

-11.4 

-.891 

-.001 

36.4 

-.114 

.033 

36.4 

-11.4 

.083 

.83  3 

36.4 

-11.4 

.883 

.333 

36.4 

-11.4 

.033 

.033 

36.4 

-11.4 

.333 

.m 

36.4 

-11.4 

.833 

.033 

36.4 

-11.4 

.338 

.833 

34.4 

-11.4 

.839 

.883 

36.4 

-11.4 

.033 

.838 

36.4 

-11.4 

.833 

.033 

36.4 

-11.4 

.839 

.903 

36.4 

-IM 

.935 

.335 

36.4 

-11.4 

.835 

.335 

36.4 

-11.4 

.035 

.835 

36.4 

-11.4 

.335 

.335 

36.4 

-11.4 

.033 

.833 

36.4 

-11.4 

.039 

.838 

34.4 

-11.4 

.903 

.0  33 

36.4 

-11.4 

.880 

.803 

36.4 

-11.4 

.863 

.068 

36.4 

-11.4 

.368 

.868 

36.4 

-11.4 

.868 

.868 

END 

RESULTS  OF  RUN 


1 . 2  sec  no  movement 


Not  recorded  by 
program  because  it 
was  building 
when  run  ended _ 


Program  does  not  look 
at  last  seven  points 
on  a  run. 


NUMBER  OF  TIMES  THE  PITCH  EASE  HAS  CHANCED  --5 
HBER  OF  TIMES  THE  BANK  BASE  HAS  CHANCED  =5 

HBER  OF  PERIODS  OF  MOVEMENT  =3 
MBER  OF  PERIODS  OF  NO  MOVEMENT  =4 

HBER  OF  TENTHS  OF  SECONDS  »  7i 


HUMBER  OF  TENTHS  NOT  ACCOUN'ED  FOR  =  4 
MOVEMENTS 

9  9  9 

NO  MOVEMENTS 
4  8  18  12 


Fig.  E- 5- -Continued 
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Raw  Data  on  Stick  Movements 


This  appendix  contains  the  raw  data  determined 
through  the  FORTRAN  program  in  Appendix  F.  This  data 
was  used  to  determine  the  flight  control  input  distribu¬ 
tions  for  use  in  the  model.  Histograms  of  this  data  are 
presented  in  Appendix  G.  Data  is  in  tenths  of  seconds. 
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Fig.  F-6 .  Raw  Data,  250  Feet,  No  stick  Movements 
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This  appendix  contains  nine  figures  which  display 
histograms  of  the  stick  movements  and  non-movements  for  each 
pilot  at  each  altitude. 
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Fig.  G-l.  Distributions,  Pilot  A,  1000  Feet 
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Fig.  G-3.  Distributions,  Pilot  C,  1000  Feet 
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Fig.  G-4 .  Distributions,  Pilot  A,  500  Feet 
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Fig.  G-5.  Distributions,  Pilot  B,  500  Feet 
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Fig.  G-7 .  Distributions,  Pilot  A,  250  Feet 
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NUMBER  OF  OCCURRENCES  NUMBER  OF  OCCURRENCES 

0.0  5.0  10.0  15.0  30.0  25.0  0.0  5.0  10.0  15.0  20.0 


O 


STICK  MOVEMENTS 


lire  IN  SECONDS 


NO  STICK  MOVEMENTS 


TIME  IN  SECONDS 


PILOT  B,  2S0  FEET 

Fig.  G-8.  Distributions,  Pilot  B,  250  Feet 
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STICK  MOVEMENTS 


TIME  IN  SECONDS 


NO  STICK  MOVEMENTS 


TIME  IN  SECONDS 


PILOT  C,  250  FEET 

Fig.  G-9.  Distributions,  Pilot  C,  250  Feet 
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K-S  Tests  of  Aircraft  Control  Movement  Distributions 


This  appendix  contains  the  Kolmogorov-Smirnov  test 
results  used  to  compare  individual  pilot  data  between 
altitudes  and  between  pilots. 


I 


TABLE  X 


K-S  TWO-SAMPLE  TEST 
(p  =  probability) 

Stick  Movements  No  Stick  Movements 

1000  FEET 
Pilot  A  with 
Pilot  A  with 
Pilot  B  with 


500  FEET 

Pilot  A  with 

Pilot 

B 

p  =  .000 

p  =  .022 

Pilot  A  with 

Pilot 

C 

p  =  .000 

p  -  .212 

Pilot  B  with 

Pilot 

C 

p  =  .223 

p  =  .172 

250  FEET 

Pilo-  A  with  Pilot  B 
Pilot  A  with  Pilot  C 
Pilot  B  with  Pilot  C 


001 

P  = 

.125 

133 

P  = 

.996 

100 

P  = 

.047 

Pilot 

B 

p  =  .007 

P  = 

.978 

Pilot 

C 

p  =  .001 

P  = 

.277 

Pilot 

C 

p  =  .140 

P  = 

.081 

TABLE  XI 


K-S  TWO-SAMPLE  TEST 
(p  =  probability) 


Stick 

Movements 

No  Stick 
Movements 

PILOT  A 

1000  Feet 

with 

500 

Feet 

P  = 

.130 

P 

=  .074 

1000  Feet 

with 

250 

Feet 

P  = 

.877 

P 

=  1.0 

500  Feet 

with 

250 

Feet 

P  = 

.116 

P 

=  .084 

PILOT  B 

1000  Feet 

with 

500 

Feet 

P  = 

.064 

P 

=  .354 

1000  Feet 

with 

250 

Feet 

P  = 

.575 

P 

=  .320 

500  Feet 

with 

250 

Feet 

P  = 

.617 

P 

=  .158 

PILOT  C  ' 

1000  Feet 

with 

500 

Feet 

P  = 

.994 

P 

=  .390 

1000  Feet 

with 

250 

Feet 

P  = 

.175 

P 

=  .544 

500  Feet 

with 

250 

Feet 

P  = 

.387 

P 

=  .983 

Analysis  of  Variance  Procedure  Results 

This  appendix  contains  SPSS  ANOVA  output  for  the 
two-way  ANOVA  and  the  one-way  ANOVA  with  a  Duncan's  Multiple 
Range  Test. 


i 
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RESULTS  OF  THE  TWO-WAY  ANOVA 


•  *****  i  i  ANALYSIS  OF  VARIANCE  HintH 
TINE 
BT  ECH 
ALT 

HI*t(«Mil  miHililUHilHHHIlH 


sun  of 

KEAN 

SIGNIF 

SOURCE  OF  VARIATION 

SQUARES 

DF  SQUARE 

F 

OF  F 

HAIM  EFFECTS 

274464,990 

4  68616.247 

33.861 

.001 

ECH 

10333.244 

2  5166.622 

2.553 

.084 

not  siq. 

ALT 

264131.746 

2132065.873 

65.172 

.801 

significant 

Z-UAf  INTERACTIONS 

2439.377 

4  609.844 

.301 

.877 

ECH  ALT 

2439.377 

4  609.844 

.301 

.877 

not  siq. 

ETPLA1NED 

276904.367 

8  34613.046 

17.081 

.001 

RESIDUAL 

182376.669 

90  2026.407 

TOTAL 

459281.036 

98  4686.541 

RESULTS  OF  THE  ONE-WAY  ANOVA 
ANALYSIS  OF  VARIANCE 


SOURCE 

D.F. 

SUM  OF  sa. 

KEAN  SO.  F  RATIO 

F  PROB 

BETWEEN 

CROUPS 

8 

276904.367 

34613.046  17.231 

.020  significant 

WITHIN 

CROUPS 

90 

182376.669 

2026.487 

TOTAL 

98 

459281.836 

STAND. 

STAND. 

95  PERCENT 

CROUP  COUNT  MEAN  DEV. 

ERROR 

KIN.  KAX.  CONF  INT  FOR  KEAN 

CRP 

1 

11 

1194.00 

26.05 

7.85 

1157.61 

1222.78 

1176.53 

TO 

1211.51 

CRP 

2 

11 

1205.41 

39.53 

11.91 

1157.69 

1279.90 

1178.88 

TO 

1231.95 

CRP 

3 

11 

1223.61 

39.83 

12.21 

1150.21 

1264.54 

1177.06 

TO 

1233.57 

CRP 

4 

11 

1185.43 

35.62 

10.74 

1124.77 

1252.34 

1161.50 

TO 

1239.37 

CRP 

5 

11 

1197.07 

33.75 

10.18 

1137.08 

1244.70 

1174.40 

TO 

1219.74 

CRP 

6 

11 

1213.32 

33.61 

10.13 

1163.69 

1269.40 

1195.74 

TO 

1240.90 

CRP 

7 

11 

1292.53 

61.91 

18.67 

1179.81 

1331.00 

1250.94 

TO 

1334.12 

CRP 

8 

11 

1313.72 

44.74 

13.49 

1242.40 

1368.66 

1283.66 

TO 

1343.77 

CRP 

9 

It 

1324.49 

71.00 

21.41 

1262.48 

1514.33 

1276.79 

TO 

1372.19 

TOTAL 

99 

1237.20 

1124.77 

1514.33 
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RESULTS  OF  THE  DUNCAN  MULTIPLE  RANGE  TEST 
MULTIPLE  RANGE  TEST 


DUNCAN  PROCEDURE 
RANGES  FOR  THE  .050  LEVEL  - 

2.81  2.96  3.05  3.12  3.18  3.23  3.27  3.30 

THE  RANGES  ABOVE  ARE  TABULAR  VALUES. 

THE  VALUE  ACTUALLY  COMPARED  WITH  MEAN (J) -MEAN C I )  IS.. 

31.8309  *  RANGE  *  SQRTU/Ntl)  ♦  1/N(J)> 

HOHOCENEOUS  SUBSETS  (SUGSETS  OF  GROUPS.  WHOSE  HIGHEST  AND  LOWEST  MEANS  DO 
NOT  DIFFER  BT  MORE  THAN  THE  SHORTEST  SIGNFICANT  RANGE  FOR  A 
SUBSET  OF  THAT  SIZE) 

SUESET  1 

CROUP  GRP  4  CRP  1  GRP  5  GRP  3  GRP  2  GRP  6 
MEAN  1185.4330  1194.0050  1197.0692  1203.8124  1205.4133  1218.3162 


SUBSET  2 

CROUP  GRP  7  GRP  8  GRP  9 
HEAN  1292.5285  1313.7167  1324.4883 


Groups  1-6  =  All  ECM  levels  at  250  and  500  feet  AGL. 

Groups  7-9  =  All  ECM  levels  at  1000  feet  AGL. 

Groups  1-6  have  a  statistically  lower  workload  than 
groups  7-9. 


Analysis  of  Variance  Procedure  Assumption  Tests 


This  appendix  contains  the  tests  made  on  the  data 
used  in  the  ANOVA  to  confirm  the  applicability  of  the 
procedure.  The  tests  included  are: 

1.  A  Runs  Test  for  Independence. 

2.  A  Hartley  F-max  Test  for  Constant  Variance. 


3.  A  Kolmogorov-Smirnov  Test  for  Normality  of 
Residuals . 


Test  for  Independence 


A  Runs  Test  (Ref  6:688)  was  used  to  confirm  the 
independence  of  the  data  points  used  in  the  ANOVA. 


Data  Cell 


Point 

Above 

Mean 


Point 

Below 

Mean 


Runs 

Allowable 


Runs 

Observed 


Test  for  Normality 


The  K-S  Test  was  used  to  evaluate  the  normality  of 

the  data  in  each  cell.  Nine  tests  were  run. 

Hn:  the  11  data  points  in  each  cell  can  be  charac¬ 
terized  by  a  normal  distribution. 

H. :  the  11  data  points  in  each  cell  cannot  be  charac¬ 
terized  by  a  normal  distribution. 


Data  Cell 

Observed 

Statistic 

Test 

Statistic 

Result 

1 

.2284 

.3910 

Fail 

to 

reject 

2 

.1952 

.3910 

Fail 

to 

reject 

3 

.1950 

.3910 

Fail 

to 

reject 

4 

.1523 

.3910 

Fail 

to 

reject 

5 

.1985 

.3910 

Fail 

to 

reject 

6 

.1692 

.3910 

Fail 

to 

reject 

7 

.1863 

.3910 

Fail 

to 

reject 

8 

.1408 

.3910 

Fail 

to 

reject 

9 

.1408 

.3910 

Fail 

to 

reject 
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